SlideShare une entreprise Scribd logo
1  sur  38
Télécharger pour lire hors ligne
Accurator
Finding the Niches in the Crowd
De menagerie, Melchior d' Hondecoeter, ca. 1690
Lizzy Jongma, Chris Dijkshoorn
Lora Aroyo
@LizzyJongma @Rasvaan @Laroyo
Take Home Messages
It takes two to tango
how to bridge enthusiasts with museum needs
Embrace the unexpected
how to learn from the crowd
Open & structured
how your standards help your experts
Not every expert is equal
how to adapt to different expert types
Combine work & pleasure
how to engage and reward your expert crowd
Facts & Figures
1.200.000 objects
700.000 works of art on paper
8.400 objects on display in the museum
650.000 records in CMS
300.000 high res images
546.000 objects online
232.000 high res images online
216.000 objects available under CC0/PD license
Audience Engagement Experiments
Woman Reading a Letter, Johannes Vermeer, c. 1663
Ich bin sehr überrascht, da überdeutlich Gefechtsschäden und
Kanoneneinschüsse an vielen Schiffen zu erkennen sind. Warum
trägt also diese Arbeit die Zeitbestimmung "voor het
bombardement"?  
Ihre Beschreibung wurde in der Wikipedia , anders formuliert,
übernommen. So setzt sich die falsche Beschreibung weiter fort...
[Link:
http://commons.wikimedia.org/wiki/File:Nicolaas_Baur_-
_Krijgsraad_aan_boord_van_de_%27Queen_Charlotte%27.jpg;
http://nl.wikipedia.org/wiki/Bombardementen_op_Algiers]
 
Mit freundlichen Grüßen
Do you have pictures of the marks on this
object, a tazza made in 1622 in Bergen op
Zoom?
Thanks, a fan of silver works from Bergen op
Zoom.
Merkelbagh should be Merckelbagh.
The Library of the Rijks’ holds a letter
and brochure of him with his name
spelled in the latter form.
Council of War on board the 'Queen Charlotte', commanded by Lord Exmouth, prior to the Bombardment of Algiers, 26 August 1816, Nicolaas Baur,
1818
it takes two to tango
how to bridge enthusiasts with museum needs
SealincMedia Project
https://sealincmedia.wordpress.com
Manipulating Social Roles in a Tagging Environment
Human Computation and Crowdsourcing: Works in Progress and Demonstration Abstracts
AAAI Technical Report CR-13-01
embrace the unexpected
how to learn from the crowd
Semantic technologies to support annotations
Open Data Model & Autocompletion from structured vocabs
Linked Data (EDM)
- different label types
- tear down language &
jargon barriers
- scientific vs. common
names
- tailored to needs of
institution for information
collection
open & structured
how your standards help your experts
The 1st
Accurator
http://www.accurator.nl/
The 2nd
Accurator
Profiling the Experts
http://annotate.accurator.nl/
not every expert is equal
how to adapt to different expert types
Bouquet of Flowers, Anonymous,
1680
Choose your domain
Find gaps in collections
SAME IconClass CODE!
Horeb/Sinaï, Burning Bush, Snake
Exodus 2:23-4:31
Moses at the Burning Bush
BIBLE!
BIRDS!
Bird Watching
in the Rijksmuseum
RP-T- 1898-A- 3679, De jacht op de Hop.
combine work & pleasure
how to engage and reward your expert crowd
Take Home Messages
It takes two to tango
how to bridge enthusiasts with museum needs
Embrace the unexpected
how to learn from the crowd
Open & structured
how your standards help your experts
Not every expert is equal
how to adapt to different expert types
Combine work & pleasure
how to engage and reward your expert crowd
@LizzyJongma @Rasvaan @Laroyo
Try Accurator
http://annotate.accurator.nl/

Contenu connexe

En vedette

DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons with DIVE+
DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons  with DIVE+DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons  with DIVE+
DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons with DIVE+Lora Aroyo
 
Stitch by Stitch: Annotating Fashion at the Rijksmuseum
Stitch by Stitch: Annotating Fashion at the RijksmuseumStitch by Stitch: Annotating Fashion at the Rijksmuseum
Stitch by Stitch: Annotating Fashion at the RijksmuseumLora Aroyo
 
CrowdTruth for Digital Hermeneutics
CrowdTruth for Digital HermeneuticsCrowdTruth for Digital Hermeneutics
CrowdTruth for Digital HermeneuticsLora Aroyo
 
Keynote @Final NWO CATCH Program Event
Keynote @Final NWO CATCH Program EventKeynote @Final NWO CATCH Program Event
Keynote @Final NWO CATCH Program EventLora Aroyo
 
(Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014
(Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014
(Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014 Lora Aroyo
 
Gamification of crowdsourcing tasks: What motivates a medical expert?
Gamification of crowdsourcing tasks: What motivates a medical expert?Gamification of crowdsourcing tasks: What motivates a medical expert?
Gamification of crowdsourcing tasks: What motivates a medical expert?CrowdTruth
 
Visualization of Disagreement-based Quality Metrics of Crowdsourcing Data
Visualization of Disagreement-based Quality Metrics of Crowdsourcing DataVisualization of Disagreement-based Quality Metrics of Crowdsourcing Data
Visualization of Disagreement-based Quality Metrics of Crowdsourcing DataCrowdTruth
 
Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)
Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)
Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)Lora Aroyo
 
Crowdsourcing Disagreement on Open-Domain Questions
Crowdsourcing Disagreement on Open-Domain QuestionsCrowdsourcing Disagreement on Open-Domain Questions
Crowdsourcing Disagreement on Open-Domain QuestionsBenjamin Timmermans
 
Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)
Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)
Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)Lora Aroyo
 
Semantic Digital Humanities Workshop 2015 @Oxford
Semantic Digital Humanities Workshop 2015 @OxfordSemantic Digital Humanities Workshop 2015 @Oxford
Semantic Digital Humanities Workshop 2015 @OxfordLora Aroyo
 
ESWC - PhD Symposium 2016
ESWC - PhD Symposium 2016ESWC - PhD Symposium 2016
ESWC - PhD Symposium 2016oanainel
 
Exploiting disagreement through open ended tasks for capturing interpretation...
Exploiting disagreement through open ended tasks for capturing interpretation...Exploiting disagreement through open ended tasks for capturing interpretation...
Exploiting disagreement through open ended tasks for capturing interpretation...Benjamin Timmermans
 
WebSci2013 Harnessing Disagreement in Crowdsourcing
WebSci2013 Harnessing Disagreement in CrowdsourcingWebSci2013 Harnessing Disagreement in Crowdsourcing
WebSci2013 Harnessing Disagreement in CrowdsourcingLora Aroyo
 
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...CrowdTruth
 
TEDx Navesink 2015: to be AND not to be - Quantum Intelligence
TEDx Navesink 2015: to be AND not to be - Quantum IntelligenceTEDx Navesink 2015: to be AND not to be - Quantum Intelligence
TEDx Navesink 2015: to be AND not to be - Quantum IntelligenceLora Aroyo
 
CrowdTruth @VU Faculty Colloquium (June 2015)
CrowdTruth @VU Faculty Colloquium (June 2015)CrowdTruth @VU Faculty Colloquium (June 2015)
CrowdTruth @VU Faculty Colloquium (June 2015)Lora Aroyo
 
Towards Better Media Understanding and Searchability
Towards Better Media Understanding and SearchabilityTowards Better Media Understanding and Searchability
Towards Better Media Understanding and Searchabilityoanainel
 
Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014
Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014
Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014Lora Aroyo
 

En vedette (19)

DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons with DIVE+
DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons  with DIVE+DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons  with DIVE+
DIVE+ @ NLeSymposium 2015: Towards New Cultural Commons with DIVE+
 
Stitch by Stitch: Annotating Fashion at the Rijksmuseum
Stitch by Stitch: Annotating Fashion at the RijksmuseumStitch by Stitch: Annotating Fashion at the Rijksmuseum
Stitch by Stitch: Annotating Fashion at the Rijksmuseum
 
CrowdTruth for Digital Hermeneutics
CrowdTruth for Digital HermeneuticsCrowdTruth for Digital Hermeneutics
CrowdTruth for Digital Hermeneutics
 
Keynote @Final NWO CATCH Program Event
Keynote @Final NWO CATCH Program EventKeynote @Final NWO CATCH Program Event
Keynote @Final NWO CATCH Program Event
 
(Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014
(Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014
(Presentation Chris) Crowdsourcing & Semantic Web: Dagstuhl 2014
 
Gamification of crowdsourcing tasks: What motivates a medical expert?
Gamification of crowdsourcing tasks: What motivates a medical expert?Gamification of crowdsourcing tasks: What motivates a medical expert?
Gamification of crowdsourcing tasks: What motivates a medical expert?
 
Visualization of Disagreement-based Quality Metrics of Crowdsourcing Data
Visualization of Disagreement-based Quality Metrics of Crowdsourcing DataVisualization of Disagreement-based Quality Metrics of Crowdsourcing Data
Visualization of Disagreement-based Quality Metrics of Crowdsourcing Data
 
Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)
Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)
Crowdsourcing & Semantic Web: Dagstuhl 2014 (Presentation Lora)
 
Crowdsourcing Disagreement on Open-Domain Questions
Crowdsourcing Disagreement on Open-Domain QuestionsCrowdsourcing Disagreement on Open-Domain Questions
Crowdsourcing Disagreement on Open-Domain Questions
 
Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)
Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)
Truth is a Lie: Rules & Semantics from Crowd Perspectives (RR'2015 Keynote)
 
Semantic Digital Humanities Workshop 2015 @Oxford
Semantic Digital Humanities Workshop 2015 @OxfordSemantic Digital Humanities Workshop 2015 @Oxford
Semantic Digital Humanities Workshop 2015 @Oxford
 
ESWC - PhD Symposium 2016
ESWC - PhD Symposium 2016ESWC - PhD Symposium 2016
ESWC - PhD Symposium 2016
 
Exploiting disagreement through open ended tasks for capturing interpretation...
Exploiting disagreement through open ended tasks for capturing interpretation...Exploiting disagreement through open ended tasks for capturing interpretation...
Exploiting disagreement through open ended tasks for capturing interpretation...
 
WebSci2013 Harnessing Disagreement in Crowdsourcing
WebSci2013 Harnessing Disagreement in CrowdsourcingWebSci2013 Harnessing Disagreement in Crowdsourcing
WebSci2013 Harnessing Disagreement in Crowdsourcing
 
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...
 
TEDx Navesink 2015: to be AND not to be - Quantum Intelligence
TEDx Navesink 2015: to be AND not to be - Quantum IntelligenceTEDx Navesink 2015: to be AND not to be - Quantum Intelligence
TEDx Navesink 2015: to be AND not to be - Quantum Intelligence
 
CrowdTruth @VU Faculty Colloquium (June 2015)
CrowdTruth @VU Faculty Colloquium (June 2015)CrowdTruth @VU Faculty Colloquium (June 2015)
CrowdTruth @VU Faculty Colloquium (June 2015)
 
Towards Better Media Understanding and Searchability
Towards Better Media Understanding and SearchabilityTowards Better Media Understanding and Searchability
Towards Better Media Understanding and Searchability
 
Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014
Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014
Truth is a Lie: 7 Myths about Human Annotation @CogComputing Forum 2014
 

Similaire à Finding the Niches in the Crowd: Engaging Expert Volunteers

Open, Connected & Smart Heritage: Towards New Cultural Commons
Open, Connected & Smart Heritage: Towards New Cultural CommonsOpen, Connected & Smart Heritage: Towards New Cultural Commons
Open, Connected & Smart Heritage: Towards New Cultural CommonsLora Aroyo
 
Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770
Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770
Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770Atmos
 
Describing Everything - Open Web standards and classification
Describing Everything - Open Web standards and classificationDescribing Everything - Open Web standards and classification
Describing Everything - Open Web standards and classificationDan Brickley
 
Open science
Open scienceOpen science
Open sciencepeterpur
 
Research, Copyright & Creative Commons
Research, Copyright & Creative CommonsResearch, Copyright & Creative Commons
Research, Copyright & Creative CommonsMathias Klang
 
Technology in the Mindful Museum
Technology in the Mindful MuseumTechnology in the Mindful Museum
Technology in the Mindful MuseumCAMT
 
Exit Control. Enter Creative Chaos.
Exit Control. Enter Creative Chaos. Exit Control. Enter Creative Chaos.
Exit Control. Enter Creative Chaos. Merete Sanderhoff
 
A presentation about the traces left behind on twitter about the conference "...
A presentation about the traces left behind on twitter about the conference "...A presentation about the traces left behind on twitter about the conference "...
A presentation about the traces left behind on twitter about the conference "...Margarida Fonseca
 
Agi Techsig 2009
Agi Techsig 2009Agi Techsig 2009
Agi Techsig 2009Joanne Cook
 
Last name 2 student namekatherine burtonenglish 122date
Last name 2 student namekatherine burtonenglish 122dateLast name 2 student namekatherine burtonenglish 122date
Last name 2 student namekatherine burtonenglish 122datesherni1
 
Artistic Practice and The Archive
Artistic Practice and The ArchiveArtistic Practice and The Archive
Artistic Practice and The ArchiveAndrew Prescott
 
Virtual Worlds for the Humanities, Arts, and Social Sciences
Virtual Worlds for the Humanities, Arts, and Social SciencesVirtual Worlds for the Humanities, Arts, and Social Sciences
Virtual Worlds for the Humanities, Arts, and Social SciencesRichard Urban
 
Catalogue of tipping point of failure exhibition by rosa menkman
Catalogue of tipping point of failure exhibition by rosa menkmanCatalogue of tipping point of failure exhibition by rosa menkman
Catalogue of tipping point of failure exhibition by rosa menkmanRosa ɯǝukɯɐn
 
Art Criticism Student Example Art Criticism, Art Analysis,
Art Criticism Student Example Art Criticism, Art Analysis,Art Criticism Student Example Art Criticism, Art Analysis,
Art Criticism Student Example Art Criticism, Art Analysis,Amy Roman
 
Descriptive Essay Tips.pdf
Descriptive Essay Tips.pdfDescriptive Essay Tips.pdf
Descriptive Essay Tips.pdfJennifer Reese
 
Elements Of Essay With Its Definition. Online assignment writing service.
Elements Of Essay With Its Definition. Online assignment writing service.Elements Of Essay With Its Definition. Online assignment writing service.
Elements Of Essay With Its Definition. Online assignment writing service.Pamela Watkins
 

Similaire à Finding the Niches in the Crowd: Engaging Expert Volunteers (20)

Open, Connected & Smart Heritage: Towards New Cultural Commons
Open, Connected & Smart Heritage: Towards New Cultural CommonsOpen, Connected & Smart Heritage: Towards New Cultural Commons
Open, Connected & Smart Heritage: Towards New Cultural Commons
 
Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770
Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770
Alex Haw Lecture - 091017 - AA 1st Year - SECTS - 770
 
Describing Everything - Open Web standards and classification
Describing Everything - Open Web standards and classificationDescribing Everything - Open Web standards and classification
Describing Everything - Open Web standards and classification
 
Open science
Open scienceOpen science
Open science
 
Research, Copyright & Creative Commons
Research, Copyright & Creative CommonsResearch, Copyright & Creative Commons
Research, Copyright & Creative Commons
 
Technology in the Mindful Museum
Technology in the Mindful MuseumTechnology in the Mindful Museum
Technology in the Mindful Museum
 
Exit Control. Enter Creative Chaos.
Exit Control. Enter Creative Chaos. Exit Control. Enter Creative Chaos.
Exit Control. Enter Creative Chaos.
 
A presentation about the traces left behind on twitter about the conference "...
A presentation about the traces left behind on twitter about the conference "...A presentation about the traces left behind on twitter about the conference "...
A presentation about the traces left behind on twitter about the conference "...
 
Agi Techsig 2009
Agi Techsig 2009Agi Techsig 2009
Agi Techsig 2009
 
1.10 tjarda de haan
1.10 tjarda de haan1.10 tjarda de haan
1.10 tjarda de haan
 
Wipo pub 925
Wipo pub 925Wipo pub 925
Wipo pub 925
 
Last name 2 student namekatherine burtonenglish 122date
Last name 2 student namekatherine burtonenglish 122dateLast name 2 student namekatherine burtonenglish 122date
Last name 2 student namekatherine burtonenglish 122date
 
Artistic Practice and The Archive
Artistic Practice and The ArchiveArtistic Practice and The Archive
Artistic Practice and The Archive
 
Virtual Worlds for the Humanities, Arts, and Social Sciences
Virtual Worlds for the Humanities, Arts, and Social SciencesVirtual Worlds for the Humanities, Arts, and Social Sciences
Virtual Worlds for the Humanities, Arts, and Social Sciences
 
Wgong 2012
Wgong 2012Wgong 2012
Wgong 2012
 
Catalogue of tipping point of failure exhibition by rosa menkman
Catalogue of tipping point of failure exhibition by rosa menkmanCatalogue of tipping point of failure exhibition by rosa menkman
Catalogue of tipping point of failure exhibition by rosa menkman
 
Sharing is daring 09052012
Sharing is daring 09052012Sharing is daring 09052012
Sharing is daring 09052012
 
Art Criticism Student Example Art Criticism, Art Analysis,
Art Criticism Student Example Art Criticism, Art Analysis,Art Criticism Student Example Art Criticism, Art Analysis,
Art Criticism Student Example Art Criticism, Art Analysis,
 
Descriptive Essay Tips.pdf
Descriptive Essay Tips.pdfDescriptive Essay Tips.pdf
Descriptive Essay Tips.pdf
 
Elements Of Essay With Its Definition. Online assignment writing service.
Elements Of Essay With Its Definition. Online assignment writing service.Elements Of Essay With Its Definition. Online assignment writing service.
Elements Of Essay With Its Definition. Online assignment writing service.
 

Plus de Lora Aroyo

NeurIPS2023 Keynote: The Many Faces of Responsible AI.pdf
NeurIPS2023 Keynote: The Many Faces of Responsible AI.pdfNeurIPS2023 Keynote: The Many Faces of Responsible AI.pdf
NeurIPS2023 Keynote: The Many Faces of Responsible AI.pdfLora Aroyo
 
CATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine Learning
CATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine LearningCATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine Learning
CATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine LearningLora Aroyo
 
Harnessing Human Semantics at Scale (updated)
Harnessing Human Semantics at Scale (updated)Harnessing Human Semantics at Scale (updated)
Harnessing Human Semantics at Scale (updated)Lora Aroyo
 
Data excellence: Better data for better AI
Data excellence: Better data for better AIData excellence: Better data for better AI
Data excellence: Better data for better AILora Aroyo
 
CHIP Demonstrator presentation @ CATCH Symposium
CHIP Demonstrator presentation @ CATCH SymposiumCHIP Demonstrator presentation @ CATCH Symposium
CHIP Demonstrator presentation @ CATCH SymposiumLora Aroyo
 
Semantic Web Challenge: CHIP Demonstrator
Semantic Web Challenge: CHIP DemonstratorSemantic Web Challenge: CHIP Demonstrator
Semantic Web Challenge: CHIP DemonstratorLora Aroyo
 
The Rijksmuseum Collection as Linked Data
The Rijksmuseum Collection as Linked DataThe Rijksmuseum Collection as Linked Data
The Rijksmuseum Collection as Linked DataLora Aroyo
 
Keynote at International Conference of Art Libraries 2018 @Rijksmuseum
Keynote at International Conference of Art Libraries 2018 @RijksmuseumKeynote at International Conference of Art Libraries 2018 @Rijksmuseum
Keynote at International Conference of Art Libraries 2018 @RijksmuseumLora Aroyo
 
FAIRview: Responsible Video Summarization @NYCML'18
FAIRview: Responsible Video Summarization @NYCML'18FAIRview: Responsible Video Summarization @NYCML'18
FAIRview: Responsible Video Summarization @NYCML'18Lora Aroyo
 
Understanding bias in video news & news filtering algorithms
Understanding bias in video news & news filtering algorithmsUnderstanding bias in video news & news filtering algorithms
Understanding bias in video news & news filtering algorithmsLora Aroyo
 
StorySourcing: Telling Stories with Humans & Machines
StorySourcing: Telling Stories with Humans & MachinesStorySourcing: Telling Stories with Humans & Machines
StorySourcing: Telling Stories with Humans & MachinesLora Aroyo
 
Data Science with Humans in the Loop
Data Science with Humans in the LoopData Science with Humans in the Loop
Data Science with Humans in the LoopLora Aroyo
 
Digital Humanities Benelux 2017: Keynote Lora Aroyo
Digital Humanities Benelux 2017: Keynote Lora AroyoDigital Humanities Benelux 2017: Keynote Lora Aroyo
Digital Humanities Benelux 2017: Keynote Lora AroyoLora Aroyo
 
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...Lora Aroyo
 
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017Crowdsourcing ambiguity aware ground truth - collective intelligence 2017
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017Lora Aroyo
 
My ESWC 2017 keynote: Disrupting the Semantic Comfort Zone
My ESWC 2017 keynote: Disrupting the Semantic Comfort ZoneMy ESWC 2017 keynote: Disrupting the Semantic Comfort Zone
My ESWC 2017 keynote: Disrupting the Semantic Comfort ZoneLora Aroyo
 
Data Science with Human in the Loop @Faculty of Science #Leiden University
Data Science with Human in the Loop @Faculty of Science #Leiden UniversityData Science with Human in the Loop @Faculty of Science #Leiden University
Data Science with Human in the Loop @Faculty of Science #Leiden UniversityLora Aroyo
 
#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...
#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...
#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...Lora Aroyo
 
#CrowdTruth: Linked Data for Information Extraction @ISWC2015
#CrowdTruth: Linked Data for Information Extraction @ISWC2015#CrowdTruth: Linked Data for Information Extraction @ISWC2015
#CrowdTruth: Linked Data for Information Extraction @ISWC2015Lora Aroyo
 

Plus de Lora Aroyo (19)

NeurIPS2023 Keynote: The Many Faces of Responsible AI.pdf
NeurIPS2023 Keynote: The Many Faces of Responsible AI.pdfNeurIPS2023 Keynote: The Many Faces of Responsible AI.pdf
NeurIPS2023 Keynote: The Many Faces of Responsible AI.pdf
 
CATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine Learning
CATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine LearningCATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine Learning
CATS4ML Data Challenge: Crowdsourcing Adverse Test Sets for Machine Learning
 
Harnessing Human Semantics at Scale (updated)
Harnessing Human Semantics at Scale (updated)Harnessing Human Semantics at Scale (updated)
Harnessing Human Semantics at Scale (updated)
 
Data excellence: Better data for better AI
Data excellence: Better data for better AIData excellence: Better data for better AI
Data excellence: Better data for better AI
 
CHIP Demonstrator presentation @ CATCH Symposium
CHIP Demonstrator presentation @ CATCH SymposiumCHIP Demonstrator presentation @ CATCH Symposium
CHIP Demonstrator presentation @ CATCH Symposium
 
Semantic Web Challenge: CHIP Demonstrator
Semantic Web Challenge: CHIP DemonstratorSemantic Web Challenge: CHIP Demonstrator
Semantic Web Challenge: CHIP Demonstrator
 
The Rijksmuseum Collection as Linked Data
The Rijksmuseum Collection as Linked DataThe Rijksmuseum Collection as Linked Data
The Rijksmuseum Collection as Linked Data
 
Keynote at International Conference of Art Libraries 2018 @Rijksmuseum
Keynote at International Conference of Art Libraries 2018 @RijksmuseumKeynote at International Conference of Art Libraries 2018 @Rijksmuseum
Keynote at International Conference of Art Libraries 2018 @Rijksmuseum
 
FAIRview: Responsible Video Summarization @NYCML'18
FAIRview: Responsible Video Summarization @NYCML'18FAIRview: Responsible Video Summarization @NYCML'18
FAIRview: Responsible Video Summarization @NYCML'18
 
Understanding bias in video news & news filtering algorithms
Understanding bias in video news & news filtering algorithmsUnderstanding bias in video news & news filtering algorithms
Understanding bias in video news & news filtering algorithms
 
StorySourcing: Telling Stories with Humans & Machines
StorySourcing: Telling Stories with Humans & MachinesStorySourcing: Telling Stories with Humans & Machines
StorySourcing: Telling Stories with Humans & Machines
 
Data Science with Humans in the Loop
Data Science with Humans in the LoopData Science with Humans in the Loop
Data Science with Humans in the Loop
 
Digital Humanities Benelux 2017: Keynote Lora Aroyo
Digital Humanities Benelux 2017: Keynote Lora AroyoDigital Humanities Benelux 2017: Keynote Lora Aroyo
Digital Humanities Benelux 2017: Keynote Lora Aroyo
 
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...
 
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017Crowdsourcing ambiguity aware ground truth - collective intelligence 2017
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017
 
My ESWC 2017 keynote: Disrupting the Semantic Comfort Zone
My ESWC 2017 keynote: Disrupting the Semantic Comfort ZoneMy ESWC 2017 keynote: Disrupting the Semantic Comfort Zone
My ESWC 2017 keynote: Disrupting the Semantic Comfort Zone
 
Data Science with Human in the Loop @Faculty of Science #Leiden University
Data Science with Human in the Loop @Faculty of Science #Leiden UniversityData Science with Human in the Loop @Faculty of Science #Leiden University
Data Science with Human in the Loop @Faculty of Science #Leiden University
 
#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...
#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...
#CrowdTruth: Biomedical Data Mining, Modeling & Semantic Integration (BDM2I 2...
 
#CrowdTruth: Linked Data for Information Extraction @ISWC2015
#CrowdTruth: Linked Data for Information Extraction @ISWC2015#CrowdTruth: Linked Data for Information Extraction @ISWC2015
#CrowdTruth: Linked Data for Information Extraction @ISWC2015
 

Dernier

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesThousandEyes
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 

Dernier (20)

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 

Finding the Niches in the Crowd: Engaging Expert Volunteers

  • 1. Accurator Finding the Niches in the Crowd De menagerie, Melchior d' Hondecoeter, ca. 1690 Lizzy Jongma, Chris Dijkshoorn Lora Aroyo @LizzyJongma @Rasvaan @Laroyo
  • 2. Take Home Messages It takes two to tango how to bridge enthusiasts with museum needs Embrace the unexpected how to learn from the crowd Open & structured how your standards help your experts Not every expert is equal how to adapt to different expert types Combine work & pleasure how to engage and reward your expert crowd
  • 3. Facts & Figures 1.200.000 objects 700.000 works of art on paper 8.400 objects on display in the museum 650.000 records in CMS 300.000 high res images 546.000 objects online 232.000 high res images online 216.000 objects available under CC0/PD license
  • 4.
  • 5.
  • 6.
  • 8. Woman Reading a Letter, Johannes Vermeer, c. 1663
  • 9. Ich bin sehr überrascht, da überdeutlich Gefechtsschäden und Kanoneneinschüsse an vielen Schiffen zu erkennen sind. Warum trägt also diese Arbeit die Zeitbestimmung "voor het bombardement"?   Ihre Beschreibung wurde in der Wikipedia , anders formuliert, übernommen. So setzt sich die falsche Beschreibung weiter fort... [Link: http://commons.wikimedia.org/wiki/File:Nicolaas_Baur_- _Krijgsraad_aan_boord_van_de_%27Queen_Charlotte%27.jpg; http://nl.wikipedia.org/wiki/Bombardementen_op_Algiers]   Mit freundlichen Grüßen Do you have pictures of the marks on this object, a tazza made in 1622 in Bergen op Zoom? Thanks, a fan of silver works from Bergen op Zoom. Merkelbagh should be Merckelbagh. The Library of the Rijks’ holds a letter and brochure of him with his name spelled in the latter form. Council of War on board the 'Queen Charlotte', commanded by Lord Exmouth, prior to the Bombardment of Algiers, 26 August 1816, Nicolaas Baur, 1818
  • 10. it takes two to tango how to bridge enthusiasts with museum needs
  • 12.
  • 13. Manipulating Social Roles in a Tagging Environment Human Computation and Crowdsourcing: Works in Progress and Demonstration Abstracts AAAI Technical Report CR-13-01
  • 14.
  • 15. embrace the unexpected how to learn from the crowd
  • 16. Semantic technologies to support annotations Open Data Model & Autocompletion from structured vocabs
  • 17. Linked Data (EDM) - different label types - tear down language & jargon barriers - scientific vs. common names - tailored to needs of institution for information collection
  • 18. open & structured how your standards help your experts
  • 20.
  • 23. not every expert is equal how to adapt to different expert types
  • 24. Bouquet of Flowers, Anonymous, 1680 Choose your domain Find gaps in collections
  • 25. SAME IconClass CODE! Horeb/Sinaï, Burning Bush, Snake Exodus 2:23-4:31 Moses at the Burning Bush BIBLE!
  • 27.
  • 28. Bird Watching in the Rijksmuseum
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34. RP-T- 1898-A- 3679, De jacht op de Hop.
  • 35.
  • 36. combine work & pleasure how to engage and reward your expert crowd
  • 37. Take Home Messages It takes two to tango how to bridge enthusiasts with museum needs Embrace the unexpected how to learn from the crowd Open & structured how your standards help your experts Not every expert is equal how to adapt to different expert types Combine work & pleasure how to engage and reward your expert crowd @LizzyJongma @Rasvaan @Laroyo