SlideShare une entreprise Scribd logo
1  sur  22
How I spend my summer
vacations
Justin F. Brunelle
WS-DL Research Group
Department of Computer Science
Old Dominion University
WADL 2013
Justin in a nutshell
• PhD Student at ODU
• Dynamic representations
–in the archives
–Improved quality from
–archived data
–Alter-ego: Application Developer
• at The MITRE Corporation
–Big data & cloud computing
How much can we archive?
The setup
• 1,000 URIs from Twitter
• 1,000 URIs from Archive-it
• Capture with tools
• Study the archivability
Good
Good
Good
Meh…
Zombies in the Archives
Bad
Bad
Bad
Bad
Bad
Why?
Losing the Moment
• What we share != What we curate
• 4.2% of Twitter is perfectly archived
–Losing My Revolution: 11% gone in 2 years
• 34.2% of Archive-it is perfectly archived
• Accessibility? Gov vs. non-Gov?
Measuring memento damage
VS.
Not all embedded resources are
created equal
Not all embedded resources are
created equal
Planned Work
• Evaluate importance of missing stuff
–Size, position
–# CSS Classes
–Not all stylesheets created equal
– Missing border vs missing functionality
– “Whitespace”
–Provide Web service
• Mechanical Turk evaluation of “damage”
• Evaluate collections of mementos
What does it all mean?
• Archivability is measurable
• Damage is measurable
• If we can predict archivability….
–We can try new methods of archiving on “hard to
capture” mementos
–Attempt repairs on existing mementos
–Gauge our successes in real-time
• Next step: capturing dynamic content
How I spend my summer vacations

Contenu connexe

En vedette

Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Making Enterprise-Level Archive Tools Accessible for Personal Web ArchivingMaking Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Mat Kelly
 

En vedette (6)

Tweet Visibility Dynamics in a Tweet Conversation Graph
Tweet Visibility Dynamics in a Tweet Conversation GraphTweet Visibility Dynamics in a Tweet Conversation Graph
Tweet Visibility Dynamics in a Tweet Conversation Graph
 
Old Dominion University Computer Science IIPC New Member
Old Dominion University Computer Science IIPC New Member Old Dominion University Computer Science IIPC New Member
Old Dominion University Computer Science IIPC New Member
 
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Making Enterprise-Level Archive Tools Accessible for Personal Web ArchivingMaking Enterprise-Level Archive Tools Accessible for Personal Web Archiving
Making Enterprise-Level Archive Tools Accessible for Personal Web Archiving
 
Combining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
Combining Heritrix and PhantomJS for Better Crawling of Pages with JavascriptCombining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
Combining Heritrix and PhantomJS for Better Crawling of Pages with Javascript
 
Libyan digital newspapers_after_revolution
Libyan digital newspapers_after_revolutionLibyan digital newspapers_after_revolution
Libyan digital newspapers_after_revolution
 
PID Signposting Pattern
PID Signposting PatternPID Signposting Pattern
PID Signposting Pattern
 

Similaire à How I spend my summer vacations

Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
SEAD
 
Designing a synergistic relationship between undergraduate Data Science educa...
Designing a synergistic relationship between undergraduate Data Science educa...Designing a synergistic relationship between undergraduate Data Science educa...
Designing a synergistic relationship between undergraduate Data Science educa...
Ciera Martinez
 
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
SEAD
 
Jaffe o'brien-rosetta
Jaffe o'brien-rosettaJaffe o'brien-rosetta
Jaffe o'brien-rosetta
ENUG
 

Similaire à How I spend my summer vacations (20)

Learning Analytics - CET Seminar 2012
Learning Analytics - CET Seminar 2012Learning Analytics - CET Seminar 2012
Learning Analytics - CET Seminar 2012
 
We Went Mobile! (Or Did We?)
We Went Mobile! (Or Did We?) We Went Mobile! (Or Did We?)
We Went Mobile! (Or Did We?)
 
Big Data Curricula at the UW eScience Institute, JSM 2013
Big Data Curricula at the UW eScience Institute, JSM 2013Big Data Curricula at the UW eScience Institute, JSM 2013
Big Data Curricula at the UW eScience Institute, JSM 2013
 
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
 
Designing a synergistic relationship between undergraduate Data Science educa...
Designing a synergistic relationship between undergraduate Data Science educa...Designing a synergistic relationship between undergraduate Data Science educa...
Designing a synergistic relationship between undergraduate Data Science educa...
 
552 guestlecture 20140308
552 guestlecture 20140308552 guestlecture 20140308
552 guestlecture 20140308
 
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
#mytweet via Instagram: Exploring User Behaviour Across Multiple Social Networks
 
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
#CitSciNZ2018 - Andrea Wiggins (University of Nebraska) Fitness for Intended ...
 
Planning a Successful Digital Project
Planning a Successful Digital ProjectPlanning a Successful Digital Project
Planning a Successful Digital Project
 
Data sharing in the age of the Social Machine
Data sharing in the age of the Social MachineData sharing in the age of the Social Machine
Data sharing in the age of the Social Machine
 
When Search becomes Research and Research becomes Search
When Search becomes Research and Research becomes SearchWhen Search becomes Research and Research becomes Search
When Search becomes Research and Research becomes Search
 
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
 
Ethnographically-inspired usability testing
Ethnographically-inspired usability testingEthnographically-inspired usability testing
Ethnographically-inspired usability testing
 
Visualising activity in learning networks using open data and educational ...
Visualising activity in learning networks   using open data and educational  ...Visualising activity in learning networks   using open data and educational  ...
Visualising activity in learning networks using open data and educational ...
 
Jaffe o'brien-rosetta
Jaffe o'brien-rosettaJaffe o'brien-rosetta
Jaffe o'brien-rosetta
 
Big and Small Web Data
Big and Small Web DataBig and Small Web Data
Big and Small Web Data
 
Crowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical TurkCrowdsourcing for HCI Research with Amazon Mechanical Turk
Crowdsourcing for HCI Research with Amazon Mechanical Turk
 
Hany's JCDL Doctoral Consortium
Hany's JCDL Doctoral ConsortiumHany's JCDL Doctoral Consortium
Hany's JCDL Doctoral Consortium
 
Lecture4 Social Web
Lecture4 Social Web Lecture4 Social Web
Lecture4 Social Web
 
Hany's Doctoral Consortium
Hany's Doctoral ConsortiumHany's Doctoral Consortium
Hany's Doctoral Consortium
 

Plus de Justin Brunelle

Agile Engineering - ODU ACM
Agile Engineering - ODU ACMAgile Engineering - ODU ACM
Agile Engineering - ODU ACM
Justin Brunelle
 

Plus de Justin Brunelle (9)

Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...
Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...
Scripts in a Frame: A Two-Tiered Crawling Approach to Archiving Deferred Repr...
 
Not All Mementos Are Created Equal: Measuring The Impact Of Missing Mementos
Not All Mementos Are Created Equal: Measuring The Impact Of Missing MementosNot All Mementos Are Created Equal: Measuring The Impact Of Missing Mementos
Not All Mementos Are Created Equal: Measuring The Impact Of Missing Mementos
 
An Evaluation of Caching Policies for Memento TimeMaps
An Evaluation of Caching Policies for Memento TimeMapsAn Evaluation of Caching Policies for Memento TimeMaps
An Evaluation of Caching Policies for Memento TimeMaps
 
Filling in the Blanks: Capturing Dynamically Generated Content
Filling in the Blanks: Capturing Dynamically Generated ContentFilling in the Blanks: Capturing Dynamically Generated Content
Filling in the Blanks: Capturing Dynamically Generated Content
 
Day in the Life of a Computer Scientist
Day in the Life of a Computer ScientistDay in the Life of a Computer Scientist
Day in the Life of a Computer Scientist
 
Agile Engineering - ODU ACM
Agile Engineering - ODU ACMAgile Engineering - ODU ACM
Agile Engineering - ODU ACM
 
Records expo
Records expoRecords expo
Records expo
 
Digital Preservation - ODU
Digital Preservation - ODUDigital Preservation - ODU
Digital Preservation - ODU
 
Digital Preservation at ODU
Digital Preservation at ODUDigital Preservation at ODU
Digital Preservation at ODU
 

Dernier

Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...
Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...
Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...
baharayali
 
Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...
Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...
Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...
baharayali
 
Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...
Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...
Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...
baharayali
 
Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...
Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...
Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...
makhmalhalaaay
 
Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...
Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...
Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...
baharayali
 

Dernier (20)

Jude: The Acts of the Apostate: High Handed Sins (vv.5-7).pptx
Jude: The Acts of the Apostate: High Handed Sins (vv.5-7).pptxJude: The Acts of the Apostate: High Handed Sins (vv.5-7).pptx
Jude: The Acts of the Apostate: High Handed Sins (vv.5-7).pptx
 
From The Heart v8.pdf xxxxxxxxxxxxxxxxxxx
From The Heart v8.pdf xxxxxxxxxxxxxxxxxxxFrom The Heart v8.pdf xxxxxxxxxxxxxxxxxxx
From The Heart v8.pdf xxxxxxxxxxxxxxxxxxx
 
Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...
Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...
Famous kala ilam, Black magic specialist in Pakistan Or Kala jadu expert in E...
 
Pathankot Escorts 🥰 8617370543 Call Girls Offer VIP Hot Girls
Pathankot Escorts 🥰 8617370543 Call Girls Offer VIP Hot GirlsPathankot Escorts 🥰 8617370543 Call Girls Offer VIP Hot Girls
Pathankot Escorts 🥰 8617370543 Call Girls Offer VIP Hot Girls
 
"The Magnificent Surah Rahman: PDF Version"
"The Magnificent Surah Rahman: PDF Version""The Magnificent Surah Rahman: PDF Version"
"The Magnificent Surah Rahman: PDF Version"
 
Human Design Gates Cheat Sheet | Kabastro.com
Human Design Gates Cheat Sheet | Kabastro.comHuman Design Gates Cheat Sheet | Kabastro.com
Human Design Gates Cheat Sheet | Kabastro.com
 
Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...
Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...
Famous Kala Jadu, Black magic expert in UK and Kala ilam expert in Saudi Arab...
 
Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...
Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...
Famous Kala Jadu, Black magic specialist in Rawalpindi and Bangali Amil baba ...
 
NO1 Trending Black Magic Specialist Expert Amil baba in Lahore Islamabad Rawa...
NO1 Trending Black Magic Specialist Expert Amil baba in Lahore Islamabad Rawa...NO1 Trending Black Magic Specialist Expert Amil baba in Lahore Islamabad Rawa...
NO1 Trending Black Magic Specialist Expert Amil baba in Lahore Islamabad Rawa...
 
St. Louise de Marillac and Care of the Sick Poor
St. Louise de Marillac and Care of the Sick PoorSt. Louise de Marillac and Care of the Sick Poor
St. Louise de Marillac and Care of the Sick Poor
 
Meaning of 22 numbers in Matrix Destiny Chart | 22 Energy Calculator
Meaning of 22 numbers in Matrix Destiny Chart | 22 Energy CalculatorMeaning of 22 numbers in Matrix Destiny Chart | 22 Energy Calculator
Meaning of 22 numbers in Matrix Destiny Chart | 22 Energy Calculator
 
Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...
Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...
Certified Amil baba, Black magic specialist in Russia and Kala jadu expert in...
 
Peaceful Meditation | Peaceful Way by Kabastro
Peaceful Meditation | Peaceful Way by KabastroPeaceful Meditation | Peaceful Way by Kabastro
Peaceful Meditation | Peaceful Way by Kabastro
 
Exploring the Meaning of Jesus’ Ascension
Exploring the Meaning of Jesus’ AscensionExploring the Meaning of Jesus’ Ascension
Exploring the Meaning of Jesus’ Ascension
 
Famous Best astrologer in Islamabad / Amil baba in Islamabad/ Amil baba in UK...
Famous Best astrologer in Islamabad / Amil baba in Islamabad/ Amil baba in UK...Famous Best astrologer in Islamabad / Amil baba in Islamabad/ Amil baba in UK...
Famous Best astrologer in Islamabad / Amil baba in Islamabad/ Amil baba in UK...
 
Balaghat Escorts 🥰 8617370543 Call Girls Offer VIP Hot Girls
Balaghat Escorts 🥰 8617370543 Call Girls Offer VIP Hot GirlsBalaghat Escorts 🥰 8617370543 Call Girls Offer VIP Hot Girls
Balaghat Escorts 🥰 8617370543 Call Girls Offer VIP Hot Girls
 
The_Chronological_Life_of_Christ_Part_99_Words_and_Works
The_Chronological_Life_of_Christ_Part_99_Words_and_WorksThe_Chronological_Life_of_Christ_Part_99_Words_and_Works
The_Chronological_Life_of_Christ_Part_99_Words_and_Works
 
Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...
Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...
Real Kala Jadu, Black magic specialist in Lahore and Kala ilam expert in kara...
 
The Revelation Chapter 4 Working Copy.docx
The Revelation Chapter 4 Working Copy.docxThe Revelation Chapter 4 Working Copy.docx
The Revelation Chapter 4 Working Copy.docx
 
Codex Singularity: Search for the Prisca Sapientia
Codex Singularity: Search for the Prisca SapientiaCodex Singularity: Search for the Prisca Sapientia
Codex Singularity: Search for the Prisca Sapientia
 

How I spend my summer vacations

  • 1. How I spend my summer vacations Justin F. Brunelle WS-DL Research Group Department of Computer Science Old Dominion University WADL 2013
  • 2. Justin in a nutshell • PhD Student at ODU • Dynamic representations –in the archives –Improved quality from –archived data –Alter-ego: Application Developer • at The MITRE Corporation –Big data & cloud computing
  • 3. How much can we archive?
  • 4. The setup • 1,000 URIs from Twitter • 1,000 URIs from Archive-it • Capture with tools • Study the archivability
  • 9. Bad
  • 10. Bad
  • 11. Bad
  • 12. Bad
  • 13. Bad
  • 14. Why?
  • 15. Losing the Moment • What we share != What we curate • 4.2% of Twitter is perfectly archived –Losing My Revolution: 11% gone in 2 years • 34.2% of Archive-it is perfectly archived • Accessibility? Gov vs. non-Gov?
  • 17. VS.
  • 18. Not all embedded resources are created equal
  • 19. Not all embedded resources are created equal
  • 20. Planned Work • Evaluate importance of missing stuff –Size, position –# CSS Classes –Not all stylesheets created equal – Missing border vs missing functionality – “Whitespace” –Provide Web service • Mechanical Turk evaluation of “damage” • Evaluate collections of mementos
  • 21. What does it all mean? • Archivability is measurable • Damage is measurable • If we can predict archivability…. –We can try new methods of archiving on “hard to capture” mementos –Attempt repairs on existing mementos –Gauge our successes in real-time • Next step: capturing dynamic content