1.
Using the JPEG2000 image format for storage and access in biodiversity collections. Chris Freeland Missouri Botanical Garden

2.
Overview of JPEG2000 <ul><li>Wavelet-based compression </li></ul><ul><ul><li>Different than JPEG </li></ul></ul><ul><ul><li>Decompress without extracting entire file </li></ul></ul><ul><li>Proposed in 2000 to supercede JPEG </li></ul><ul><ul><li>Hasn’t </li></ul></ul><ul><li>Slow adoption in museums & libraries </li></ul><ul><ul><li>Poor (no) native browser support </li></ul></ul><ul><ul><li>Few open source options </li></ul></ul><ul><li>Faster adoption in medical imaging, other commercial applications </li></ul>

3.
Parts of the format <ul><li>Part 1 , Core coding system (JP2) </li></ul><ul><ul><li>defines format; adopted as standard first. </li></ul></ul><ul><li>Part 2 , Extensions </li></ul><ul><li>Part 3 , Motion JPEG 2000 </li></ul><ul><li>Part 4 , Conformance </li></ul><ul><li>Part 5 , Reference software </li></ul><ul><li>Part 6 , Compound image file format (JPM) </li></ul><ul><li>Part 7 has been abandoned </li></ul><ul><li>Part 8 , Security (JPSEC) </li></ul><ul><li>Part 9 , Protocols and API (JPIP) </li></ul><ul><li>Part 10 , JP3D ( volumetric imaging ) </li></ul><ul><li>Part 11 , JPWL ( wireless applications ) </li></ul><ul><li>Part 12 , ISO Base Media File Format ( common w/ MPEG-4 ) </li></ul>

4.
Advantages of JPEG2000 <ul><li>Region extraction </li></ul><ul><li>Compression </li></ul><ul><ul><li>Both lossless & lossy </li></ul></ul><ul><li>Self-containedness </li></ul><ul><ul><li>XML metadata + image </li></ul></ul><ul><ul><li>Multiple objects can be bundled together </li></ul></ul><ul><li>Progressive Transmission </li></ul><ul><ul><li>Lower quality at early load </li></ul></ul>http://www.dlib.org/dlib/september08/chute/09chute.html

5.
Region Extraction “ Give me x , y coordinates at z resolution.” 600ppi, 200MB TIF; encode to 100MB JP2 72ppi: 20KB JPG

6.
“ How many books in a ___?” <ul><li>2 Biblioburros; 4,800 books* </li></ul>*http://www.nytimes.com/2008/10/20/world/americas/20burro.html Luis Soriano, with Alpha and Beto <ul><ul><li>1 Biblioburro = 2,400 books </li></ul></ul><ul><ul><li>BHL to date = 9 Biblioburros! </li></ul></ul>

7.
Storage requirement for a digital Biblioburro <ul><li>2,400 books / Biblioburro </li></ul><ul><ul><li>(9,238,295 pages / 22,118 books in BHL) = 418 pages / book </li></ul></ul><ul><ul><li>1,002,437 pages / Biblioburro </li></ul></ul><ul><li>Avg size of each image file </li></ul><ul><ul><li>RAW/TIF: 24MB ; JP2: 2MB </li></ul></ul><ul><li>Drive space needed / Biblioburro </li></ul><ul><ul><li>TIF: 24TB ; JP2: 2TB </li></ul></ul>2,400 books 24 TB TIFs 2 TB JP2 = =

8.
Self-containedness / metadata bundling <ul><li>Not just an image, but an image, its content & its context </li></ul><ul><ul><li>Adobe XMP </li></ul></ul><ul><ul><li>Dublin Core </li></ul></ul><ul><ul><li>Your own XML </li></ul></ul><ul><ul><ul><li>TIF Headers & JPEG limit fields </li></ul></ul></ul><ul><li>Can describe more than just an image </li></ul><ul><ul><li>A whole web site </li></ul></ul>

9.
Barriers for adoption <ul><li>Lack of affordable, scalable serving options </li></ul><ul><ul><li>Until recently, no open source server </li></ul></ul><ul><ul><li>Commercial options expensive </li></ul></ul><ul><li>No native browser support </li></ul><ul><ul><li>Safari does , but via QuickTime </li></ul></ul><ul><ul><li>But why?? </li></ul></ul><ul><ul><ul><li>PNG? </li></ul></ul></ul><ul><ul><ul><li>No motivation? </li></ul></ul></ul><ul><li>Community skepticism </li></ul>

10.
Encoding Software <ul><li>Commercial </li></ul><ul><ul><li>Adobe Photoshop </li></ul></ul><ul><ul><li>LuraTech SDK </li></ul></ul><ul><ul><li>LizardTech </li></ul></ul><ul><li>Non-Commercial </li></ul><ul><ul><li>Kakadu </li></ul></ul><ul><ul><li>ImageMagik </li></ul></ul><ul><ul><li>IrfanView </li></ul></ul>

11.
Decoding & Serving <ul><li>Commercial </li></ul><ul><ul><li>LizardTech </li></ul></ul><ul><ul><li>Aware </li></ul></ul><ul><ul><li>LuraTech ICS </li></ul></ul><ul><ul><li>FSIV </li></ul></ul><ul><li>Non-Commercial </li></ul><ul><ul><li>Kakadu </li></ul></ul><ul><ul><li>GSIV </li></ul></ul><ul><ul><li>djatoka </li></ul></ul>

12.
Part 6: JPIP <ul><li>Protocol and API for transmitting JP2 </li></ul><ul><li>Designed for HTTP, but not restricted to that carrier </li></ul><ul><ul><li>Don’t need a browser </li></ul></ul><ul><li>Implementations are available, use is infrequent </li></ul><ul><ul><li>HiRISE camera on Mars Reconnaissance Orbiter </li></ul></ul>

13.
Current use of JP2 in BHL <ul><li>Serve 85% (lossy) .jp2 </li></ul><ul><li>LizardTech decoder </li></ul><ul><ul><li>Tiled on the fly </li></ul></ul><ul><ul><li>Cached for performance </li></ul></ul><ul><li>GSIV browser-based client viewer </li></ul>

14.
LizardTech ExpressServer Browser GSIV.js www.biodiversitylibrary.org .jp2 .jpg Internet Archive /page/1274907 pageid: 1274907 BHLdb http://www.archive.org/download/mushroomsofameri00palm/.../mushroomsofameri00palm_0010.jp2 images.mobot.org A user requests Mushrooms of America, edible and poisonous , Plate X: http://www.biodiversitylibrary.org/page/1274907 locate:

19.
The Future: djatoka <ul><li>Developed at Los Alamos National Laboratory, Research Library </li></ul><ul><li>Use of the ISO-standardized JPEG 2000 format [ 6 ] as the service format; </li></ul><ul><li>Java-based open source solution built around the Kakudu JPEG 2000 library; </li></ul><ul><li>Geared towards reuse through URI-addressability of all image disseminations including regions, rotations, and format transformations; </li></ul><ul><li>Provision of a consistent, guessable URI pattern for image disseminations based on the ANSI/NISO OpenURL standard [ 7 ]; </li></ul><ul><li>Provision of an extensible service framework for image disseminations enabled by OCLC's Java OpenURL package ; </li></ul><ul><li>Availability of image disseminations in a range of image formats; </li></ul><ul><li>Availability of image disseminations for locally stored JPEG 2000 files, as well as for Web-accessible images in a variety of formats; </li></ul><ul><li>Configurable server-side, file-based caching; </li></ul><ul><li>Ajax-based client reference implementation, based on IIPImage JavaScript Viewer , which allows panning, zooming, and selecting the URI of the current view. </li></ul>http://www.dlib.org/dlib/september08/chute/09chute.html

20.
References <ul><li>djatoka </li></ul><ul><ul><li>http://www.dlib.org/dlib/july08/buonora/07buonora.html </li></ul></ul><ul><li>HUL: Page Image Compression for Mass Digitization </li></ul><ul><ul><li>http:// preserve.harvard.edu/massdig/hul_study / </li></ul></ul><ul><li>JP2 in Libraries and Archives </li></ul><ul><ul><li>http://j2karclib.info/taxonomy/term/2 </li></ul></ul><ul><li>JPEG 2000 - a Practical Digital Preservation Standard? </li></ul><ul><ul><li>http://www.dpconline.org/docs/reports/dpctw08-01.pdf </li></ul></ul><ul><li>JPEG2000 site </li></ul><ul><ul><li>http://www.jpeg.org/jpeg2000/ </li></ul></ul>

21.
Contact <ul><ul><li>Chris Freeland </li></ul></ul><ul><ul><li>Missouri Botanical Garden </li></ul></ul><ul><ul><li>4344 Shaw Blvd. </li></ul></ul><ul><ul><li>St. Louis, MO 63110 </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>http://www.chrisfreeland.com </li></ul></ul>