SlideShare a Scribd company logo
1 of 35
A Small Archive in the Cloud Using inexpensive tools  + open source + cloud computing  ... to sleep soundly at night Ari Davidow Jewish Women’s Archive Presentation for the New England Archivists Association April 2, 2011
10 years+ of audio and video oral histories6TB Data
Optical Media  are not a preservation format Optical Media
$10k for a RAID server
Reasonably secure
What if there is a disaster?
Pair with others? can we find two other organizations? each has to buy $20k of servers in addition to their own each has to be maintained as professionally (or better) as we maintain ours....
Cloud Computingto the rescue aws.amazon.com
Step 1: BackupHow to get there? Jungle Disk – www.jungledisk.com
Digital Asset Mgmt Phase One
Admin Entryway to JWA’s WWII online Collection Project, based in Drupal
Administering a media object in Drupal. You will see similar metadata being gathered in our Fedora implementation
Control panel for Amazon Web Services
The first repository: Bella The least functionality that lets us move the digital contents from old cassettes and minidisks into active curatorial management.
Agile Development
Agile Development Put usable tools in people’s hands quickly Short, iterative programming cycles (usually, 4-6 weeks) Use cards/whiteboard to note requests When you have an acceptable set of cards that can be done in 4-6 weeks, you have your next cycle planned
Issue Tracking www.redmine.org
Code Delivery Our current “let there be no ambiguity” method: Finished code must be checked into a repository It must be documented in a wiki or other online doc tool We must be able to check out the code, follow installation instructions, and successfully integrate/launch/run the application
Contents of a typical Oral History
Repository Entryway
Editing metadata for typical Oral History in our Fedora Repository
Phase 2: Islandora Goals: Update Bella Get Drupal content and the parent objects into active management Create a place to put “random” archive assets
The New JWA Islandora/Drupal Interface in progress
What next? To find out more about the Jewish Women’s Archive, http://jwa.org If you also have a small archive in need of asset management and preservation, please get in touch with the Duraspace Small Archives Solution Community: https://wiki.duraspace.org/display/cmtygp/Small+Archives Ari Davidow is teaching a class in Cloud Computing (some programming experience recommended) for Brandeis’ Rabb Graduate Professional Studies Program, starting May 23, 2011: http://www.brandeis.edu/gps/programscourses/schedule/classes/2011/Summer/all Follow Ari on Twitter: @aridavidow

More Related Content

Similar to A small archive in the clouds

Digital preservation and curation of information.presentation
Digital preservation and curation of information.presentationDigital preservation and curation of information.presentation
Digital preservation and curation of information.presentation
Prince Sterling
 
Hypatia for dlf 2011
Hypatia for dlf 2011Hypatia for dlf 2011
Hypatia for dlf 2011
DLFCLIR
 
Tenthingsivelearnedaboutdrupal 120130164528-phpapp02
Tenthingsivelearnedaboutdrupal 120130164528-phpapp02Tenthingsivelearnedaboutdrupal 120130164528-phpapp02
Tenthingsivelearnedaboutdrupal 120130164528-phpapp02
Luisa Fernanda
 
In synch presentation pv - v0.4
In synch presentation   pv - v0.4In synch presentation   pv - v0.4
In synch presentation pv - v0.4
InSync Conference
 
Hadoop @ Sara & BiG Grid
Hadoop @ Sara & BiG GridHadoop @ Sara & BiG Grid
Hadoop @ Sara & BiG Grid
Evert Lammerts
 

Similar to A small archive in the clouds (20)

Digital preservation and curation of information.presentation
Digital preservation and curation of information.presentationDigital preservation and curation of information.presentation
Digital preservation and curation of information.presentation
 
Hypatia for dlf 2011
Hypatia for dlf 2011Hypatia for dlf 2011
Hypatia for dlf 2011
 
SHAREmodule2
SHAREmodule2SHAREmodule2
SHAREmodule2
 
OMEKA
OMEKAOMEKA
OMEKA
 
LODLAM Landscape NOTES
LODLAM Landscape NOTESLODLAM Landscape NOTES
LODLAM Landscape NOTES
 
M.Sc. Research Proposal
M.Sc. Research ProposalM.Sc. Research Proposal
M.Sc. Research Proposal
 
Tenthingsivelearnedaboutdrupal 120130164528-phpapp02
Tenthingsivelearnedaboutdrupal 120130164528-phpapp02Tenthingsivelearnedaboutdrupal 120130164528-phpapp02
Tenthingsivelearnedaboutdrupal 120130164528-phpapp02
 
Ten things i've learned about drupal
Ten things i've learned about drupalTen things i've learned about drupal
Ten things i've learned about drupal
 
Drupal for Higher Education and Virtual Learning
Drupal for Higher Education and Virtual LearningDrupal for Higher Education and Virtual Learning
Drupal for Higher Education and Virtual Learning
 
Vind 
- Information Discovery made easy
Vind  
- Information Discovery made easyVind  
- Information Discovery made easy
Vind 
- Information Discovery made easy
 
A strategic view of document and digital object management
A strategic view of document and digital object managementA strategic view of document and digital object management
A strategic view of document and digital object management
 
In synch presentation pv - v0.4
In synch presentation   pv - v0.4In synch presentation   pv - v0.4
In synch presentation pv - v0.4
 
Webinar Docker Tri Series
Webinar Docker Tri SeriesWebinar Docker Tri Series
Webinar Docker Tri Series
 
Best Practices for Managing Born Digital Content
Best Practices for Managing Born Digital ContentBest Practices for Managing Born Digital Content
Best Practices for Managing Born Digital Content
 
Near Real Time Indexing Kafka Messages into Apache Blur: Presented by Dibyend...
Near Real Time Indexing Kafka Messages into Apache Blur: Presented by Dibyend...Near Real Time Indexing Kafka Messages into Apache Blur: Presented by Dibyend...
Near Real Time Indexing Kafka Messages into Apache Blur: Presented by Dibyend...
 
F/LOSS in Norwegian libraries
F/LOSS in Norwegian librariesF/LOSS in Norwegian libraries
F/LOSS in Norwegian libraries
 
Hadoop @ Sara & BiG Grid
Hadoop @ Sara & BiG GridHadoop @ Sara & BiG Grid
Hadoop @ Sara & BiG Grid
 
160606 data lifecycle project outline
160606 data lifecycle project outline160606 data lifecycle project outline
160606 data lifecycle project outline
 
Making the Transition to Agile: what we did, what worked, and what we learned
Making the Transition to Agile: what we did, what worked, and what we learnedMaking the Transition to Agile: what we did, what worked, and what we learned
Making the Transition to Agile: what we did, what worked, and what we learned
 
Impact of Covid-19 on Learning and Education
Impact of Covid-19 on Learning and EducationImpact of Covid-19 on Learning and Education
Impact of Covid-19 on Learning and Education
 

More from Ari Davidow

More from Ari Davidow (11)

2016 12-21 rules for radical project managers
2016 12-21 rules for radical project managers2016 12-21 rules for radical project managers
2016 12-21 rules for radical project managers
 
Limmudboston2016 hebrewtypography-02
Limmudboston2016 hebrewtypography-02Limmudboston2016 hebrewtypography-02
Limmudboston2016 hebrewtypography-02
 
Limmudboston2016 hebrewtypography-01
Limmudboston2016 hebrewtypography-01Limmudboston2016 hebrewtypography-01
Limmudboston2016 hebrewtypography-01
 
Jewish music online
Jewish music onlineJewish music online
Jewish music online
 
Mashing Up History and Teaching Our Kids: The Public Is Invited
Mashing Up History and Teaching Our Kids: The Public Is InvitedMashing Up History and Teaching Our Kids: The Public Is Invited
Mashing Up History and Teaching Our Kids: The Public Is Invited
 
Project Management for the resource-challenged
Project Management for the resource-challengedProject Management for the resource-challenged
Project Management for the resource-challenged
 
Hebrew Typography1
Hebrew Typography1Hebrew Typography1
Hebrew Typography1
 
Hebrew Typography2
Hebrew Typography2Hebrew Typography2
Hebrew Typography2
 
JWA-RP
JWA-RPJWA-RP
JWA-RP
 
Moving Drupal to the Cloud
Moving Drupal to the CloudMoving Drupal to the Cloud
Moving Drupal to the Cloud
 
Project Management on one foot
Project Management on one footProject Management on one foot
Project Management on one foot
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 

Recently uploaded (20)

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 

A small archive in the clouds

  • 1. A Small Archive in the Cloud Using inexpensive tools + open source + cloud computing ... to sleep soundly at night Ari Davidow Jewish Women’s Archive Presentation for the New England Archivists Association April 2, 2011
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8. 10 years+ of audio and video oral histories6TB Data
  • 9. Optical Media are not a preservation format Optical Media
  • 10. $10k for a RAID server
  • 12. What if there is a disaster?
  • 13. Pair with others? can we find two other organizations? each has to buy $20k of servers in addition to their own each has to be maintained as professionally (or better) as we maintain ours....
  • 14. Cloud Computingto the rescue aws.amazon.com
  • 15. Step 1: BackupHow to get there? Jungle Disk – www.jungledisk.com
  • 16. Digital Asset Mgmt Phase One
  • 17.
  • 18. Admin Entryway to JWA’s WWII online Collection Project, based in Drupal
  • 19. Administering a media object in Drupal. You will see similar metadata being gathered in our Fedora implementation
  • 20. Control panel for Amazon Web Services
  • 21. The first repository: Bella The least functionality that lets us move the digital contents from old cassettes and minidisks into active curatorial management.
  • 23. Agile Development Put usable tools in people’s hands quickly Short, iterative programming cycles (usually, 4-6 weeks) Use cards/whiteboard to note requests When you have an acceptable set of cards that can be done in 4-6 weeks, you have your next cycle planned
  • 25. Code Delivery Our current “let there be no ambiguity” method: Finished code must be checked into a repository It must be documented in a wiki or other online doc tool We must be able to check out the code, follow installation instructions, and successfully integrate/launch/run the application
  • 26. Contents of a typical Oral History
  • 28. Editing metadata for typical Oral History in our Fedora Repository
  • 29. Phase 2: Islandora Goals: Update Bella Get Drupal content and the parent objects into active management Create a place to put “random” archive assets
  • 30. The New JWA Islandora/Drupal Interface in progress
  • 31.
  • 32.
  • 33.
  • 34.
  • 35. What next? To find out more about the Jewish Women’s Archive, http://jwa.org If you also have a small archive in need of asset management and preservation, please get in touch with the Duraspace Small Archives Solution Community: https://wiki.duraspace.org/display/cmtygp/Small+Archives Ari Davidow is teaching a class in Cloud Computing (some programming experience recommended) for Brandeis’ Rabb Graduate Professional Studies Program, starting May 23, 2011: http://www.brandeis.edu/gps/programscourses/schedule/classes/2011/Summer/all Follow Ari on Twitter: @aridavidow

Editor's Notes

  1. The Jewish Women’s Archive is unusual in that it is an online-only archive. There are no physical assets.
  2. It took almost three months just to back up our network servers. But then they were backed up.
  3. Actual digital asset management at this point was still the tried and true spreadsheet