Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
Isabella Stewart Gardner Museum Orientation
Sept 17, 2015
Welcome to the Cooperative!
Preservation as a Process
MetaArchiv...
MetaArchive History
● Founded 2004
● Distributed digital preservation cooperative
● Preservation aims: prevent loss and
co...
● Distributed digital preservation
● Institutions maintain control over their own
content
● Preservation as a process, not...
● Auburn University
● Boston College
● Cal Poly San Luis Obispo
● Consorci de Biblioteques
Universitaris de Catalunya
● Fl...
5
MetaArchive Practices
● Basic processes
○ “Producer” (OAIS) determines curation practices;
brings SIPs to MetaArchive
○ Mu...
● Three membership levels
○ Collaborative members: $2.5K/year
○ Preservation members: $3K/year
○ Sustaining members: $5.5K...
Membership Responsibilities
● Undertake a 3-year membership term
● Take responsibility for content preparation,
evaluation...
● MetaArchive is a cooperative, not a
vendor:
○ All hardware and software assets are owned by
members
○ Membership fees an...
● Compatible with any repository system
○ E.g., Dspace, Fedora, Archivalware, ETDb,
CONTENTdm, BePress, Digital Commons, e...
Ingest Demo / Overview
Prepare SIP
Stage Collection
● Collections consist of Archival Units (one or many)
Stage Collection
AU AU
AU
AU
AU AU
Stage Collection
● Collections consist of Archival Units (one or many)
● Archival Units contain content and metadata
Stage Collection
ARCHIVAL
UNIT
Content
+
Metadata
Stage Collection
● Collections consist of Archival Units (one or many)
● Archival Units contain content and metadata
● Col...
Stage Collection
AU AU
AU
AU
AU AU
Documentation
http://metaarchive-staging.lib.calpoly.edu
Create Collection
● Create collection level metadata for collection in
Conspectus management tool
○ Title
○ Archive
○ Desc...
Create Collection
Create Manifest Page
● Simple HTML page with basic collection description
information and links to collection content for ...
Create Manifest Page
Create Manifest Page
● Simple HTML page with basic collection description
information and links to collection content for ...
Create Manifest Page
http://metaarchive-staging.lib.calpoly.edu/mabagitmanifest.html
Develop Collection Plugin
● Plugins tell member caches where to find a designated
Manifest page and how far to follow the ...
Develop Collection Plugin
Member
Cache
AU
http://metaarchive-staging.lib.calpoly.edu
AU AU
AU AU AU
Plugin:
edu.calp.bagit...
Develop Collection Plugin
● Member creates new plugin via Conspectus based on
existing plugin, or uploads custom plugin
Develop Collection Plugin
Develop Collection Plugin
● Member creates new plugin via Conspectus based on
existing plugin, or uploads custom plugin
● ...
Develop Collection Plugin
Test & Review
Test Collection Plugin
● Member tests plugin locally and makes changes as
needed
● Member defines Plugin name and Archival...
Test Collection Plugin
Test Collection Plugin
Test Collection Plugin
Review Plugin & Test Ingest
● Member requests plugin review and test by MetaArchive
staff
● MetaArchive staff ingests coll...
Review Plugin & Test Ingest
AU AU AU
AU AU AU
Test
Cache
Test
Cache
Test
Cache
Plugin
Review Plugin & Test Ingest
● Member requests plugin review and test by MetaArchive
staff
● MetaArchive staff ingests coll...
SIP to AIP
Commit Plugin
● If test ingest is successful, MetaArchive staff commits
plugin to production plugin repository
Commit Plugin
Complete Collection Metadata
Make collection available to
network
● MetaArchive staff regenerate LOCKSS Title Database to
expose collection to producti...
AU AU
AU AU
AU
AU
Member
Cache
Member
Cache
Member
Cache
Member
Cache
Member
Cache
Member
Cache
Replicate collection
Replicate collection
Auditing Control
Auditing Control
Voting and Polling
A
U
A
U
cf2304e9b416e4c6e4d7a1bb22bf95e4 data/ua-sel_00000268-M.wav
046763d382e557359731edc1d5a8b821 da...
Voting and Polling
A
U
A
U A
U
A
U
A
U
A
U
A
U
Voting and Polling
A
U
A
U A
U
A
U
A
U
A
U
A
U
Damage and Repair
A
U
A
U
cf2304e9b416e4c6e4d7a1bb22bf95e4 data/ua-sel_00000268-M.wav
046763d382e557359731edc1d5a8b821 dat...
Damage and Repair
A
U
A
U
A
U
Hi there. Remind
me, have we talked
before?
Damage and Repair
A
U
A
U
A
U
Yep. We go way
back.
metaarchive.org
sam@educopia.org
@samalanmeister
55
Thanks!
Getting Started
56
November 2010
Attended 5-day workshop
“Digital Preservation Management”
University of Michigan
August 2...
Why MetaArchive
57
◼ Transparent
◼ Affordable
◼ Community-based
◼ Supportive
◼ Diverse
First bookmobile used by the Greene...
Modified IngestGCPL
CONTENTdm
Server
GCPL
Archive
Server
MetaArchive
Server
MetaArchive
Server
MetaArchive Server
Ingests
...
Modified IngestGCPL
CONTENTdm
Server
GCPL
Archive
Server
MetaArchive
Server
MetaArchive
Server
MetaArchive Server
Replicat...
Cost of a Digital Time Capsule….
Library Paid in 2015
Preservation Membership $3,000
Technology Fee 1,000
Storage .50¢ per...
Prochain SlideShare
Chargement dans…5
×

Preservation as a Process MetaArchive and Distributed Digital Preservation

176 vues

Publié le

Presentation by Sam Meister and Deanna Ulvestad delivered at the OhioDIG meeting on March 9, 2016

Publié dans : Technologie
  • Soyez le premier à commenter

  • Soyez le premier à aimer ceci

Preservation as a Process MetaArchive and Distributed Digital Preservation

  1. 1. Isabella Stewart Gardner Museum Orientation Sept 17, 2015 Welcome to the Cooperative! Preservation as a Process MetaArchive and Distributed Digital Preservation Sam Meister Deanna Ulvestad OhioDIG Meeting March 9, 2016
  2. 2. MetaArchive History ● Founded 2004 ● Distributed digital preservation cooperative ● Preservation aims: prevent loss and corruption from human malice/error or from a disaster ● First (known) preservation network to preserve special collections/unique materials 2
  3. 3. ● Distributed digital preservation ● Institutions maintain control over their own content ● Preservation as a process, not a push-button exercise ● Simplicity in ingest, management 3 Hallmarks
  4. 4. ● Auburn University ● Boston College ● Cal Poly San Luis Obispo ● Consorci de Biblioteques Universitaris de Catalunya ● Florida State University ● Isabella Stewart Gardner Museum ● Greene County Public Library ● HBCU Library Alliance ● Indiana State University ● Oregon State University ● Penn State University ● Pontificia Universidade Catolica do Rio de Janeiro ● Purdue University ● Rockefeller Archives Center ● University of Louisville ● University of North Texas ● University of South Carolina ● Virginia Tech University Membership
  5. 5. 5
  6. 6. MetaArchive Practices ● Basic processes ○ “Producer” (OAIS) determines curation practices; brings SIPs to MetaArchive ○ Multiple copies of AIPs dispersed across geographical, political, and environmental lines ○ Checks and repairs automated across network ○ Deaccession cycle versus data deletion 6
  7. 7. ● Three membership levels ○ Collaborative members: $2.5K/year ○ Preservation members: $3K/year ○ Sustaining members: $5.5K/year ● Server cost: <$5K/term ● Storage cost: $585/TB/year 7 MetaArchive Pricing
  8. 8. Membership Responsibilities ● Undertake a 3-year membership term ● Take responsibility for content preparation, evaluation, staging, and ingest testing ● Monitor collections to ensure accurate long-term preservation ● Host and maintain a MetaArchive cache (server) or pay in a technology support fee ● Consider contributing to Committees! 8
  9. 9. ● MetaArchive is a cooperative, not a vendor: ○ All hardware and software assets are owned by members ○ Membership fees and storage fees go to a central pool of support for members’ co-op activities 9 Cooperative Preservation
  10. 10. ● Compatible with any repository system ○ E.g., Dspace, Fedora, Archivalware, ETDb, CONTENTdm, BePress, Digital Commons, etc ● Member institutions determine their own curatorial practices ● MetaArchive is a community of support to help them make informed decisions 10 Philosophy in Practice
  11. 11. Ingest Demo / Overview
  12. 12. Prepare SIP
  13. 13. Stage Collection ● Collections consist of Archival Units (one or many)
  14. 14. Stage Collection AU AU AU AU AU AU
  15. 15. Stage Collection ● Collections consist of Archival Units (one or many) ● Archival Units contain content and metadata
  16. 16. Stage Collection ARCHIVAL UNIT Content + Metadata
  17. 17. Stage Collection ● Collections consist of Archival Units (one or many) ● Archival Units contain content and metadata ● Collections organized to be able to restore collections later ● Include documentation on restoration procedures ● Make collection web accessible at URL
  18. 18. Stage Collection AU AU AU AU AU AU Documentation http://metaarchive-staging.lib.calpoly.edu
  19. 19. Create Collection ● Create collection level metadata for collection in Conspectus management tool ○ Title ○ Archive ○ Description ○ Base URL
  20. 20. Create Collection
  21. 21. Create Manifest Page ● Simple HTML page with basic collection description information and links to collection content for LOCKSS crawlers ● LOCKSS Crawlers MUST find permission statement to be able to harvest content
  22. 22. Create Manifest Page
  23. 23. Create Manifest Page ● Simple HTML page with basic collection description information and links to collection content for LOCKSS crawlers ● LOCKSS Crawlers MUST find permission statement to be able to harvest content ● Place Manifest page on same host as content
  24. 24. Create Manifest Page http://metaarchive-staging.lib.calpoly.edu/mabagitmanifest.html
  25. 25. Develop Collection Plugin ● Plugins tell member caches where to find a designated Manifest page and how far to follow the links to harvest collection content
  26. 26. Develop Collection Plugin Member Cache AU http://metaarchive-staging.lib.calpoly.edu AU AU AU AU AU Plugin: edu.calp.bagitplugin2
  27. 27. Develop Collection Plugin ● Member creates new plugin via Conspectus based on existing plugin, or uploads custom plugin
  28. 28. Develop Collection Plugin
  29. 29. Develop Collection Plugin ● Member creates new plugin via Conspectus based on existing plugin, or uploads custom plugin ● Member gives plugin a unique name ● Member defines plugin rules to determine which files will be harvested
  30. 30. Develop Collection Plugin
  31. 31. Test & Review
  32. 32. Test Collection Plugin ● Member tests plugin locally and makes changes as needed ● Member defines Plugin name and Archival Units in Conspectus
  33. 33. Test Collection Plugin
  34. 34. Test Collection Plugin
  35. 35. Test Collection Plugin
  36. 36. Review Plugin & Test Ingest ● Member requests plugin review and test by MetaArchive staff ● MetaArchive staff ingests collection to test network
  37. 37. Review Plugin & Test Ingest AU AU AU AU AU AU Test Cache Test Cache Test Cache Plugin
  38. 38. Review Plugin & Test Ingest ● Member requests plugin review and test by MetaArchive staff ● MetaArchive staff ingests collection to test network ● MetaArchive staff sends member test ingest report to review
  39. 39. SIP to AIP
  40. 40. Commit Plugin ● If test ingest is successful, MetaArchive staff commits plugin to production plugin repository
  41. 41. Commit Plugin
  42. 42. Complete Collection Metadata
  43. 43. Make collection available to network ● MetaArchive staff regenerate LOCKSS Title Database to expose collection to production network ● MetaArchive staff assigns six geographically distributed caches to crawl and harvest the collection
  44. 44. AU AU AU AU AU AU Member Cache Member Cache Member Cache Member Cache Member Cache Member Cache
  45. 45. Replicate collection
  46. 46. Replicate collection
  47. 47. Auditing Control
  48. 48. Auditing Control
  49. 49. Voting and Polling A U A U cf2304e9b416e4c6e4d7a1bb22bf95e4 data/ua-sel_00000268-M.wav 046763d382e557359731edc1d5a8b821 data/dm-ua-sel_bag_002_MODSmetadata.xml cf9beab2c63082d0d0b40ce9a8faa0a6 data/ua-sel_00000265_001-M.wav 733298738956be7ff4d9ed6b5d021e56 data/ua-sel_00000259-M.wav
  50. 50. Voting and Polling A U A U A U A U A U A U A U
  51. 51. Voting and Polling A U A U A U A U A U A U A U
  52. 52. Damage and Repair A U A U cf2304e9b416e4c6e4d7a1bb22bf95e4 data/ua-sel_00000268-M.wav 046763d382e557359731edc1d5a8b821 data/dm-ua-sel_bag_002_MODSmetadata.xml cf9beab2c63082d0d0b40ce9a8faa0a6 data/ua-sel_00000265_001-M.wav 733298738956be7ff4d9ed6b5d021e56 data/ua-sel_00000259-M.wav cf2304e9b416e4c6e4d7a1bb22bf95e4 data/ua-sel_00000268-M.wav 046763d382e557359731edc1d5a8b821 data/dm-ua-sel_bag_002_MODSmetadata.xml cf9beab2c63082d0d0b40ce9a8faa0a6 data/ua-sel_00000265_001-M.wav 733298738956be7ff4d9ed6b5d021e57 data/ua-sel_00000259-M.wav
  53. 53. Damage and Repair A U A U A U Hi there. Remind me, have we talked before?
  54. 54. Damage and Repair A U A U A U Yep. We go way back.
  55. 55. metaarchive.org sam@educopia.org @samalanmeister 55 Thanks!
  56. 56. Getting Started 56 November 2010 Attended 5-day workshop “Digital Preservation Management” University of Michigan August 2011 Compared Digital Preservation Repository options April 2012 Joined MetaArchive as a Preservation Member January 2013 Started ingesting collections Greene County Public Library was housed in the Carnegie building from 1906 – 1978. Xenia, Ohio.
  57. 57. Why MetaArchive 57 ◼ Transparent ◼ Affordable ◼ Community-based ◼ Supportive ◼ Diverse First bookmobile used by the Greene County Public Library from 1948 – 1958. Xenia, Ohio.
  58. 58. Modified IngestGCPL CONTENTdm Server GCPL Archive Server MetaArchive Server MetaArchive Server MetaArchive Server Ingests GCPL Archive Units MetaArchive Server MetaArchive Server MetaArchive Server MetaArchive Server 58
  59. 59. Modified IngestGCPL CONTENTdm Server GCPL Archive Server MetaArchive Server MetaArchive Server MetaArchive Server Replicates GCPL Archive Units MetaArchive Server MetaArchive Server MetaArchive Server MetaArchive Server 59
  60. 60. Cost of a Digital Time Capsule…. Library Paid in 2015 Preservation Membership $3,000 Technology Fee 1,000 Storage .50¢ per GB x 3,600 GB 1,800 Total MetaArchive Fees 2015 $4,800 60 Greene County Courthouse Time Capsule of 1901 opened in 2001. Xenia, Ohio.

×