SlideShare une entreprise Scribd logo
1  sur  10
Télécharger pour lire hors ligne
Cooking the big soup
https://commons.wikimedia.org/wiki/File:Wikidata-logo-en.svg
Sebastian Burgstaller-Muehlbacher
Introduction
● Single value edits are simple, due to the web
interface of Wikidata.
● How to easily mass import data into Wikidata?
● Answer: Use Bots!
● Combine Wikidata API and query endpoints.
● Python as preferred language.
PBB_core
Resource specific code
Auxiliary classes
PBB_core
Data silo
-Get data from silo
-Clean data
-Make silo to Wikidata mapping
-Take mapped data
-Lookup WD if item already exists
-Throw exception if inconsistencies occur
-Construct or modify a WD item JSON object
-Provide logging capabilities
-Provide WD login infrastructure
-Provide settings
1.
2.
3.
4.
1. Get data and map to WD
2. Login to WD
3. Provide PBB_core with data
4. Request write to WD
What does an item look like, really?
https://goo.gl/Ndbcd4
https://www.wikidata.org/w/api.php?action=wbgetentities&ids=Q423111
A Minimal Bot
A Minimal Bot for Mass Data Import
Advantages of PBB_core
● One interface to Wikidata for (your) bots!
● Fast development and deployment of new bots.
● Integrates Wikidata querying and writing.
● Prevents creation of duplicate items.
● Searches for duplicate use of identifiers.
● Compatible to Python 2 and Python 3.
● Execute queries with SPARQL or WDQ.
● Minimizes HTTP traffic, increases throughput.
All Wikidata data types
● All current Wikidata data types have been implemented.
– PBB_core.WDString
– PBB_core.WDItemID
– PBB_core.WDMonolingualText
– PBB_core.WDProperty
– PBB_core.WDQuantity
– PBB_core.WDTime
– PBB_core.WDUrl
– PBB_core.WDGlobeCoordinate
– PBB_core.WDCommonsMedia
Conclusions
● Mass data imports require scripts/aka bots
● Our solution: PBB_core
– Python framework for reading from and writing to
Wikidata
– Implementing all Wikidata data types
– Implementing consistency checks of data to be
written.
– Get it from:
https://bitbucket.org/sulab/wikidatabots/src
Let's hack Wikidata!!
culturedigitally.org

Contenu connexe

En vedette

Kass & Browand, Is There a Written Description Requirement After All, IP Law3...
Kass & Browand, Is There a Written Description Requirement After All, IP Law3...Kass & Browand, Is There a Written Description Requirement After All, IP Law3...
Kass & Browand, Is There a Written Description Requirement After All, IP Law3...Lawrence Kass
 
Inside Intellect
Inside IntellectInside Intellect
Inside Intellecthstanke
 
A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...
A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...
A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...Lawrence Kass
 
Open Industries, WTT Insights presentation
Open Industries, WTT Insights presentationOpen Industries, WTT Insights presentation
Open Industries, WTT Insights presentationOpen Industries
 
廢核之後,電夠不夠
廢核之後,電夠不夠廢核之後,電夠不夠
廢核之後,電夠不夠志誠 謝
 
IPv6 Readiness Measurements for NZ
IPv6 Readiness Measurements for NZIPv6 Readiness Measurements for NZ
IPv6 Readiness Measurements for NZAPNIC
 
Android - Intents and Broadcast Receivers
Android - Intents and Broadcast ReceiversAndroid - Intents and Broadcast Receivers
Android - Intents and Broadcast ReceiversMingHo Chang
 
Designing High Availability Networks, Systems, and Software for the Universit...
Designing High Availability Networks, Systems, and Softwarefor the Universit...Designing High Availability Networks, Systems, and Softwarefor the Universit...
Designing High Availability Networks, Systems, and Software for the Universit...Shumon Huque
 
Tips melatih konsentrasi otak
Tips melatih konsentrasi otakTips melatih konsentrasi otak
Tips melatih konsentrasi otakHexxa Kediri
 

En vedette (15)

Kass & Browand, Is There a Written Description Requirement After All, IP Law3...
Kass & Browand, Is There a Written Description Requirement After All, IP Law3...Kass & Browand, Is There a Written Description Requirement After All, IP Law3...
Kass & Browand, Is There a Written Description Requirement After All, IP Law3...
 
Inside Intellect
Inside IntellectInside Intellect
Inside Intellect
 
Diabetic Eye Care
Diabetic Eye CareDiabetic Eye Care
Diabetic Eye Care
 
TJs resume new
TJs resume newTJs resume new
TJs resume new
 
Bb16
Bb16Bb16
Bb16
 
A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...
A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...
A Computerized Business Method Is Patentable Subject Matter, N.Y.L.J., August...
 
Open Industries, WTT Insights presentation
Open Industries, WTT Insights presentationOpen Industries, WTT Insights presentation
Open Industries, WTT Insights presentation
 
Presentation_NEW.PPTX
Presentation_NEW.PPTXPresentation_NEW.PPTX
Presentation_NEW.PPTX
 
wireless power charging
wireless power chargingwireless power charging
wireless power charging
 
廢核之後,電夠不夠
廢核之後,電夠不夠廢核之後,電夠不夠
廢核之後,電夠不夠
 
IPv6 Readiness Measurements for NZ
IPv6 Readiness Measurements for NZIPv6 Readiness Measurements for NZ
IPv6 Readiness Measurements for NZ
 
Android - Intents and Broadcast Receivers
Android - Intents and Broadcast ReceiversAndroid - Intents and Broadcast Receivers
Android - Intents and Broadcast Receivers
 
Designing High Availability Networks, Systems, and Software for the Universit...
Designing High Availability Networks, Systems, and Softwarefor the Universit...Designing High Availability Networks, Systems, and Softwarefor the Universit...
Designing High Availability Networks, Systems, and Software for the Universit...
 
User_Access_IIA-LA_3-9-2016
User_Access_IIA-LA_3-9-2016User_Access_IIA-LA_3-9-2016
User_Access_IIA-LA_3-9-2016
 
Tips melatih konsentrasi otak
Tips melatih konsentrasi otakTips melatih konsentrasi otak
Tips melatih konsentrasi otak
 

Similaire à SWAT4LS Wikidata tutorial cambridge dec 2015

Integrate External Data With The Business Data Catalog
Integrate External Data With The Business Data CatalogIntegrate External Data With The Business Data Catalog
Integrate External Data With The Business Data CatalogTom Resing
 
Bot Computing using the Power of Wiki Collaboration
Bot Computing using the Power of Wiki CollaborationBot Computing using the Power of Wiki Collaboration
Bot Computing using the Power of Wiki CollaborationTakashi Yamanoue
 
Web Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure Chest
Web Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure ChestWeb Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure Chest
Web Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure ChestAxiell ALM
 
Pbi iot data viz
Pbi iot data vizPbi iot data viz
Pbi iot data vizDavid Moss
 
Internet of Bioinformatics
Internet of BioinformaticsInternet of Bioinformatics
Internet of BioinformaticsJens Allmer
 
apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify
apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botifyapidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify
apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botifyapidays
 
Introduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and PythonIntroduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and PythonSri Ambati
 
Introduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and PythonIntroduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and PythonJo-fai Chow
 
node-crate: node.js and big data
 node-crate: node.js and big data node-crate: node.js and big data
node-crate: node.js and big dataStefan Thies
 
Strategies for Context Data Persistence
Strategies for Context Data PersistenceStrategies for Context Data Persistence
Strategies for Context Data PersistenceFIWARE
 
Python-CouchDB Training at PyCon PL 2012
Python-CouchDB Training at PyCon PL 2012Python-CouchDB Training at PyCon PL 2012
Python-CouchDB Training at PyCon PL 2012Stefan Kögl
 
Web Intelligence - Tutorial1
Web Intelligence - Tutorial1Web Intelligence - Tutorial1
Web Intelligence - Tutorial1Obily W
 
Self service reporting on Hadoop using Actuate BIRT
Self service reporting on Hadoop using Actuate BIRTSelf service reporting on Hadoop using Actuate BIRT
Self service reporting on Hadoop using Actuate BIRTVaidehi Deshpande
 
Devoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in JavaDevoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in JavaNGDATA
 
MarcEdit and OCLC Integration -- Summer ALA 2014
MarcEdit and OCLC Integration -- Summer ALA 2014MarcEdit and OCLC Integration -- Summer ALA 2014
MarcEdit and OCLC Integration -- Summer ALA 2014Terry Reese
 
Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...
Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...
Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...Riccardo Zamana
 

Similaire à SWAT4LS Wikidata tutorial cambridge dec 2015 (20)

Integrate External Data With The Business Data Catalog
Integrate External Data With The Business Data CatalogIntegrate External Data With The Business Data Catalog
Integrate External Data With The Business Data Catalog
 
Bot Computing using the Power of Wiki Collaboration
Bot Computing using the Power of Wiki CollaborationBot Computing using the Power of Wiki Collaboration
Bot Computing using the Power of Wiki Collaboration
 
Web Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure Chest
Web Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure ChestWeb Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure Chest
Web Browser Controls in Adlib: The Hidden Diamond in the Adlib Treasure Chest
 
Pbi iot data viz
Pbi iot data vizPbi iot data viz
Pbi iot data viz
 
Internet of Bioinformatics
Internet of BioinformaticsInternet of Bioinformatics
Internet of Bioinformatics
 
apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify
apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botifyapidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify
apidays LIVE Paris 2021 - Building an analytics API by David Wobrock, Botify
 
Introduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and PythonIntroduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and Python
 
Introduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and PythonIntroduction to Machine Learning with H2O and Python
Introduction to Machine Learning with H2O and Python
 
node-crate: node.js and big data
 node-crate: node.js and big data node-crate: node.js and big data
node-crate: node.js and big data
 
LOD2: State of Play WP5 - Linked Data Visualization, Browsing and Authoring
LOD2: State of Play WP5 - Linked Data Visualization, Browsing and AuthoringLOD2: State of Play WP5 - Linked Data Visualization, Browsing and Authoring
LOD2: State of Play WP5 - Linked Data Visualization, Browsing and Authoring
 
Sap bo xi r4.0
Sap bo xi r4.0Sap bo xi r4.0
Sap bo xi r4.0
 
Strategies for Context Data Persistence
Strategies for Context Data PersistenceStrategies for Context Data Persistence
Strategies for Context Data Persistence
 
Python-CouchDB Training at PyCon PL 2012
Python-CouchDB Training at PyCon PL 2012Python-CouchDB Training at PyCon PL 2012
Python-CouchDB Training at PyCon PL 2012
 
Web Intelligence - Tutorial1
Web Intelligence - Tutorial1Web Intelligence - Tutorial1
Web Intelligence - Tutorial1
 
Self service reporting on Hadoop using Actuate BIRT
Self service reporting on Hadoop using Actuate BIRTSelf service reporting on Hadoop using Actuate BIRT
Self service reporting on Hadoop using Actuate BIRT
 
Devoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in JavaDevoxx 2010 | LAB : ReST in Java
Devoxx 2010 | LAB : ReST in Java
 
MarcEdit and OCLC Integration -- Summer ALA 2014
MarcEdit and OCLC Integration -- Summer ALA 2014MarcEdit and OCLC Integration -- Summer ALA 2014
MarcEdit and OCLC Integration -- Summer ALA 2014
 
WebSphere Commerce v7 Data Load
WebSphere Commerce v7 Data LoadWebSphere Commerce v7 Data Load
WebSphere Commerce v7 Data Load
 
Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...
Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...
Time series Analytics - a deep dive into ADX Azure Data Explorer @Data Saturd...
 
Sap bo xi r4.0 short
Sap bo xi r4.0  shortSap bo xi r4.0  short
Sap bo xi r4.0 short
 

Dernier

Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Monika Rani
 
Molecular markers- RFLP, RAPD, AFLP, SNP etc.
Molecular markers- RFLP, RAPD, AFLP, SNP etc.Molecular markers- RFLP, RAPD, AFLP, SNP etc.
Molecular markers- RFLP, RAPD, AFLP, SNP etc.Silpa
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.Nitya salvi
 
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...Silpa
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)Areesha Ahmad
 
chemical bonding Essentials of Physical Chemistry2.pdf
chemical bonding Essentials of Physical Chemistry2.pdfchemical bonding Essentials of Physical Chemistry2.pdf
chemical bonding Essentials of Physical Chemistry2.pdfTukamushabaBismark
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPirithiRaju
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)Areesha Ahmad
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....muralinath2
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxseri bangash
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)Areesha Ahmad
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)Areesha Ahmad
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsSérgio Sacani
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedDelhi Call girls
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...chandars293
 
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts ServiceJustdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Servicemonikaservice1
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsOrtegaSyrineMay
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000Sapana Sha
 

Dernier (20)

Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
 
Molecular markers- RFLP, RAPD, AFLP, SNP etc.
Molecular markers- RFLP, RAPD, AFLP, SNP etc.Molecular markers- RFLP, RAPD, AFLP, SNP etc.
Molecular markers- RFLP, RAPD, AFLP, SNP etc.
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
chemical bonding Essentials of Physical Chemistry2.pdf
chemical bonding Essentials of Physical Chemistry2.pdfchemical bonding Essentials of Physical Chemistry2.pdf
chemical bonding Essentials of Physical Chemistry2.pdf
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
 
The Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptxThe Mariana Trench remarkable geological features on Earth.pptx
The Mariana Trench remarkable geological features on Earth.pptx
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verifiedConnaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
Connaught Place, Delhi Call girls :8448380779 Model Escorts | 100% verified
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts ServiceJustdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
Justdial Call Girls In Indirapuram, Ghaziabad, 8800357707 Escorts Service
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its Functions
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
 

SWAT4LS Wikidata tutorial cambridge dec 2015

  • 1. Cooking the big soup https://commons.wikimedia.org/wiki/File:Wikidata-logo-en.svg Sebastian Burgstaller-Muehlbacher
  • 2. Introduction ● Single value edits are simple, due to the web interface of Wikidata. ● How to easily mass import data into Wikidata? ● Answer: Use Bots! ● Combine Wikidata API and query endpoints. ● Python as preferred language.
  • 3. PBB_core Resource specific code Auxiliary classes PBB_core Data silo -Get data from silo -Clean data -Make silo to Wikidata mapping -Take mapped data -Lookup WD if item already exists -Throw exception if inconsistencies occur -Construct or modify a WD item JSON object -Provide logging capabilities -Provide WD login infrastructure -Provide settings 1. 2. 3. 4. 1. Get data and map to WD 2. Login to WD 3. Provide PBB_core with data 4. Request write to WD
  • 4. What does an item look like, really? https://goo.gl/Ndbcd4 https://www.wikidata.org/w/api.php?action=wbgetentities&ids=Q423111
  • 6. A Minimal Bot for Mass Data Import
  • 7. Advantages of PBB_core ● One interface to Wikidata for (your) bots! ● Fast development and deployment of new bots. ● Integrates Wikidata querying and writing. ● Prevents creation of duplicate items. ● Searches for duplicate use of identifiers. ● Compatible to Python 2 and Python 3. ● Execute queries with SPARQL or WDQ. ● Minimizes HTTP traffic, increases throughput.
  • 8. All Wikidata data types ● All current Wikidata data types have been implemented. – PBB_core.WDString – PBB_core.WDItemID – PBB_core.WDMonolingualText – PBB_core.WDProperty – PBB_core.WDQuantity – PBB_core.WDTime – PBB_core.WDUrl – PBB_core.WDGlobeCoordinate – PBB_core.WDCommonsMedia
  • 9. Conclusions ● Mass data imports require scripts/aka bots ● Our solution: PBB_core – Python framework for reading from and writing to Wikidata – Implementing all Wikidata data types – Implementing consistency checks of data to be written. – Get it from: https://bitbucket.org/sulab/wikidatabots/src