The promises of web scrapping: Mining the web for relational data about artists

•Télécharger en tant que PPTX, PDF•

1 j'aime•485 vues

Guillaume Cabanac

12 JÉ ReSTo : réseaux sociaux Toulouse https://www.irit.fr/~Guillaume.Cabanac/docs/resto2016.pdf

Sciences

The promises of web scrapping:
Mining the web for relational data about artists
Journée d’étude ResTo
14 avril 2016
Guillaume Cabanac
@gcabanac

2
Web Scrapping
The promises of web scrapping
1. Why?
2. How?
3. Case studies
4. Why not?

3
Web Scrapping
1. Why?
2. How?
3. Case studies
4. Why not?
The promises of web scrapping

4
Web Scrapping: Why?
Purpose:
Fetch the Impact Factor of indexed
journals in Computer Science

5
Web Scrapping
1. Why?
2. How?
3. Case studies
4. Why not?
The promises of web scrapping

6
Web Scrapping: How?
Source:http://www.dartlang.org/docs/tutorials/connect-dart-html/
HTML Page Structure: the Document Object Model

7
Web Scrapping
1. Why?
2. How?
3. Case studies
4. Why not?
The promises of web scrapping

9
Sunday !
Evenonbankholidaysinmanycountries!
Study 1: scientists and workaholism

Study 2: networks of references via Google Scholar
11

12
Study 2: networks of references via Google Scholar

13
Study 2: networks of references via Google Scholar

14
Study 2: networks of references via Google Scholar

15
Study 2: networks of references via Google Scholar

16
Study 2: networks of references via Google Scholar

Study 3: The world of arts – work in progress …
17

18
Study 3: The world of arts – work in progress …

19
Study 3: The world of arts – work in progress …

20
Study 3: The world of arts – work in progress …

21
Web Scrapping
1. Why?
2. How?
3. Case studies
4. Why not?
The promises of web scrapping

22
Web Scrapping: Why not ?
M Scrapping is usually forbidden

23
Web Scrapping: Why not ?
M … but things are changing, at least in the UK
http://www.slideshare.net/petermurrayrust/content-mining-at-wellcome-trust

24
M Data quality issues, especially on Google Scholar?
Web Scrapping: Why not ?

25
M Data quality issues, especially on Google Scholar?
Web Scrapping: Why not ?

Recommandé

Impact of URI Canonicalization on Memento Count Mat Kelly

MementoMap: A Web Archive Profiling Framework for Efficient Memento RoutingSawood Alam

Web Archiving Activities of ODU’s Web Science and Digital Library Research G...Michael Nelson

A Framework for Verifying the Fixity of Archived Web Resourcesmaturban

Google docs and drivetechiesue

Increasing your Learning Network – Twitter, Facebook, Google+ and the Melrose...Joshua Murdock

Into the Wild: Undergraduates & ResearchCourtney McDonald

Gagglejabernethy

Recommandé

Impact of URI Canonicalization on Memento Count Mat Kelly

MementoMap: A Web Archive Profiling Framework for Efficient Memento RoutingSawood Alam

Web Archiving Activities of ODU’s Web Science and Digital Library Research G...Michael Nelson

A Framework for Verifying the Fixity of Archived Web Resourcesmaturban

Google docs and drivetechiesue

Increasing your Learning Network – Twitter, Facebook, Google+ and the Melrose...Joshua Murdock

Into the Wild: Undergraduates & ResearchCourtney McDonald

Gagglejabernethy

Blockchain Can Not Be Used To Verify Replayed Archived Web PagesMichael Nelson

Linked Open Data for ArchivesCliff Landis

Developing Developers Through ApprenticeshipDan Pickett

Patrick hinesreferencesdatabaseprojectPatrick706

10 things statistics taught us about big datajtleek

Linksk jerong

Zerog Spinning Toyskrossbow

HKU Data Curation MLIM7350 Class 7Scott Edmunds

Le carnet de l'avent de la sociologie francophone sur Twitter : réseaux et al...Guillaume Cabanac

Searching and Recommending TV series with SQLGuillaume Cabanac

A Journey in Scientometrics: quantitative studies of science at the crossroad...Guillaume Cabanac

Interroger le texte scientifiqueGuillaume Cabanac

Web Scraping : CrawlingRaja Sekhar Emmela

Intelligent web crawlingDenis Shestakov

Monitoring and Analysis of Web Information for Various Business Contexts : Co...Dr. Haxel Consult

Web crawlerpoonamkenkre

The Semantic Web – A Vision Come True, or Giving Up the Great Plan?Martin Hepp

Science and Web2.0Ian Mulvany

Linked Datapast, present and futuresPierre-Yves Vandenbussche, Ph.D.

Learn to speak openLilian Juma

Herramientas 2.0 para comunicar la actividad científicaXavier Lasauca i Cisa

School library websites power pointckdozier

Contenu connexe

Tendances

Blockchain Can Not Be Used To Verify Replayed Archived Web PagesMichael Nelson

Linked Open Data for ArchivesCliff Landis

Developing Developers Through ApprenticeshipDan Pickett

Patrick hinesreferencesdatabaseprojectPatrick706

10 things statistics taught us about big datajtleek

Linksk jerong

Zerog Spinning Toyskrossbow

HKU Data Curation MLIM7350 Class 7Scott Edmunds

Tendances (8)

Blockchain Can Not Be Used To Verify Replayed Archived Web Pages

Linked Open Data for Archives

Developing Developers Through Apprenticeship

Patrick hinesreferencesdatabaseproject

10 things statistics taught us about big data

Link

Zerog Spinning Toys

HKU Data Curation MLIM7350 Class 7

En vedette

Le carnet de l'avent de la sociologie francophone sur Twitter : réseaux et al...Guillaume Cabanac

Searching and Recommending TV series with SQLGuillaume Cabanac

A Journey in Scientometrics: quantitative studies of science at the crossroad...Guillaume Cabanac

Interroger le texte scientifiqueGuillaume Cabanac

Web Scraping : CrawlingRaja Sekhar Emmela

Intelligent web crawlingDenis Shestakov

Monitoring and Analysis of Web Information for Various Business Contexts : Co...Dr. Haxel Consult

Web crawlerpoonamkenkre

En vedette (8)

Le carnet de l'avent de la sociologie francophone sur Twitter : réseaux et al...

Searching and Recommending TV series with SQL

A Journey in Scientometrics: quantitative studies of science at the crossroad...

Interroger le texte scientifique

Web Scraping : Crawling

Intelligent web crawling

Monitoring and Analysis of Web Information for Various Business Contexts : Co...

Web crawler

Similaire à The promises of web scrapping: Mining the web for relational data about artists

The Semantic Web – A Vision Come True, or Giving Up the Great Plan?Martin Hepp

Science and Web2.0Ian Mulvany

Linked Datapast, present and futuresPierre-Yves Vandenbussche, Ph.D.

Learn to speak openLilian Juma

Herramientas 2.0 para comunicar la actividad científicaXavier Lasauca i Cisa

School library websites power pointckdozier

Aggregating Private and Public Web Archives Using the Mementity FrameworkMat Kelly

ISWC GoodRelations Tutorial Part 1Martin Hepp

GoodRelations Tutorial Part 1guestecacad2

8 better ways of doing your engineering projecttalkingkarthik

Managing and sharing data: lessons from the European contextSarah Jones

New Technologies for the 21st Century SecretaryRafael Scapin, Ph.D.

Something about linksRoderic Page

The Path to Open Learning is Paved with Good IntentionsPatrick McAndrew

Data wrangling week 11Ferdin Joe John Joseph PhD

pp_api: PyDaysArtem Revenko

Welcome to Consuming Linked Data tutorial WWW2010Juan Sequeda

Knowledge Graphs for Scholarly CommunicationLeipziger Semantic Web Tag

Towards Knowledge Graph based Representation, Augmentation and Exploration of...Sören Auer

@WebSciDL PhD Student Project Reviews August 5&6, 2015Michael Nelson

Similaire à The promises of web scrapping: Mining the web for relational data about artists (20)

The Semantic Web – A Vision Come True, or Giving Up the Great Plan?

Science and Web2.0

Linked Datapast, present and futures

Learn to speak open

Herramientas 2.0 para comunicar la actividad científica

School library websites power point

Aggregating Private and Public Web Archives Using the Mementity Framework

ISWC GoodRelations Tutorial Part 1

GoodRelations Tutorial Part 1

8 better ways of doing your engineering project

Managing and sharing data: lessons from the European context

New Technologies for the 21st Century Secretary

Something about links

The Path to Open Learning is Paved with Good Intentions

Data wrangling week 11

pp_api: PyDays

Welcome to Consuming Linked Data tutorial WWW2010

Knowledge Graphs for Scholarly Communication

Towards Knowledge Graph based Representation, Augmentation and Exploration of...

@WebSciDL PhD Student Project Reviews August 5&6, 2015

Plus de Guillaume Cabanac

Adoption de l’identifiant ORCID : le cas des universités toulousainesGuillaume Cabanac

Dépollution de la littérature scientifique : traque d’expression torturées ...Guillaume Cabanac

Interroger la scienceGuillaume Cabanac

Valoriser le capital documentaire (en sommeil) d’une organisation : exploitat...Guillaume Cabanac

Comment analyser une mobilisation collective dans les réseaux socionumériques...Guillaume Cabanac

Gender as a Variable to Study Academic WritingGuillaume Cabanac

Prospection de textes scientifiques : vision prospectiveGuillaume Cabanac

Questionner le texte scientifique pour caractériser la science et l'innovationGuillaume Cabanac

Émergence de l’open access « gris » : LibGen et Sci-Hub comme filières clande...Guillaume Cabanac

Confrontation à la perception humaine de mesures de similarité entre membres Guillaume Cabanac

« T'as pensé à retweeter mon article ? » Enjeux, limites et critique de la bi...Guillaume Cabanac

Émergence de l’open access « gris » : LibGen et Sci-HubGuillaume Cabanac

Sur les étagères des bibliothèques numériques clandestines: Guillaume Cabanac

Les altmetrics : estimer l'engouement pour la recherche sur les médias sociauxGuillaume Cabanac

Bibliogifts ? Les bibliothèques clandestines de l'édition scientifiqueGuillaume Cabanac

Le renfort des liens forts - dynamique relationnelle du coauthorshipGuillaume Cabanac

Médias sociaux et visibilité des chercheursGuillaume Cabanac

In Praise of Interdisciplinary Research through ScientometricsGuillaume Cabanac

Programmation événementielle avec WindevGuillaume Cabanac

Scientometric Studies of Academic WritingGuillaume Cabanac

Plus de Guillaume Cabanac (20)

Adoption de l’identifiant ORCID : le cas des universités toulousaines

Dépollution de la littérature scientifique : traque d’expression torturées ...

Interroger la science

Valoriser le capital documentaire (en sommeil) d’une organisation : exploitat...

Comment analyser une mobilisation collective dans les réseaux socionumériques...

Gender as a Variable to Study Academic Writing

Prospection de textes scientifiques : vision prospective

Questionner le texte scientifique pour caractériser la science et l'innovation

Émergence de l’open access « gris » : LibGen et Sci-Hub comme filières clande...

Confrontation à la perception humaine de mesures de similarité entre membres

« T'as pensé à retweeter mon article ? » Enjeux, limites et critique de la bi...

Émergence de l’open access « gris » : LibGen et Sci-Hub

Sur les étagères des bibliothèques numériques clandestines:

Les altmetrics : estimer l'engouement pour la recherche sur les médias sociaux

Bibliogifts ? Les bibliothèques clandestines de l'édition scientifique

Le renfort des liens forts - dynamique relationnelle du coauthorship

Médias sociaux et visibilité des chercheurs

In Praise of Interdisciplinary Research through Scientometrics

Programmation événementielle avec Windev

Scientometric Studies of Academic Writing

Dernier

Let’s Say Someone Did Drop the Bomb. Then What?LUMINATIVE MEDIA/PROJECT COUNSEL MEDIA GROUP

trihybrid cross , test cross chi squaresusmanzain586

REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...Universidade Federal de Sergipe - UFS

Thermodynamics ,types of system,formulae ,gibbs free energy .pptxuniversity

Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuinethapagita

Pests of castor_Binomics_Identification_Dr.UPR.pdfPirithiRaju

well logging & petrophysical analysis.pptxzaydmeerab121

Pests of Bengal gram_Identification_Dr.UPR.pdfPirithiRaju

Four Spheres of the Earth Presentation.pptJoemSTuliba

Topic 9- General Principles of International Law.pptxJorenAcuavera1

User Guide: Pulsar™ Weather Station (Columbia Weather Systems)Columbia Weather Systems

GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptxRitchAndruAgustin

Observational constraints on mergers creating magnetism in massive starsSérgio Sacani

bonjourmadame.tumblr.com bhaskar's girlshansessene

Biological classification of plants with detailhaiderbaloch3

Base editing, prime editing, Cas13 & RNA editing and organelle base editingNetHelix

FREE NURSING BUNDLE FOR NURSES.PDF by naJASISJULIANOELYNV

Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPirithiRaju

User Guide: Capricorn FLX™ Weather StationColumbia Weather Systems

Microteaching on terms used in filtration .Pharmaceutical EngineeringPrajakta Shinde

Dernier (20)

Let’s Say Someone Did Drop the Bomb. Then What?

trihybrid cross , test cross chi squares

REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...

Thermodynamics ,types of system,formulae ,gibbs free energy .pptx

Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine

Pests of castor_Binomics_Identification_Dr.UPR.pdf

well logging & petrophysical analysis.pptx

Pests of Bengal gram_Identification_Dr.UPR.pdf

Four Spheres of the Earth Presentation.ppt

Topic 9- General Principles of International Law.pptx

User Guide: Pulsar™ Weather Station (Columbia Weather Systems)

GENERAL PHYSICS 2 REFRACTION OF LIGHT SENIOR HIGH SCHOOL GENPHYS2.pptx

Observational constraints on mergers creating magnetism in massive stars

bonjourmadame.tumblr.com bhaskar's girls

Biological classification of plants with detail

Base editing, prime editing, Cas13 & RNA editing and organelle base editing

FREE NURSING BUNDLE FOR NURSES.PDF by na

Pests of soyabean_Binomics_IdentificationDr.UPR.pdf

User Guide: Capricorn FLX™ Weather Station

Microteaching on terms used in filtration .Pharmaceutical Engineering

The promises of web scrapping: Mining the web for relational data about artists

1. The promises of web scrapping: Mining the web for relational data about artists Journée d’étude ResTo 14 avril 2016 Guillaume Cabanac @gcabanac

2. 2 Web Scrapping The promises of web scrapping 1. Why? 2. How? 3. Case studies 4. Why not?

3. 3 Web Scrapping 1. Why? 2. How? 3. Case studies 4. Why not? The promises of web scrapping

4. 4 Web Scrapping: Why? Purpose: Fetch the Impact Factor of indexed journals in Computer Science

5. 5 Web Scrapping 1. Why? 2. How? 3. Case studies 4. Why not? The promises of web scrapping

6. 6 Web Scrapping: How? Source:http://www.dartlang.org/docs/tutorials/connect-dart-html/ HTML Page Structure: the Document Object Model

7. 7 Web Scrapping 1. Why? 2. How? 3. Case studies 4. Why not? The promises of web scrapping

8. Study 1: scientists and workaholism 8

9. 9 Sunday ! Evenonbankholidaysinmanycountries! Study 1: scientists and workaholism

10. 10 Study 1: scientists and workaholism

11. Study 2: networks of references via Google Scholar 11

12. 12 Study 2: networks of references via Google Scholar

13. 13 Study 2: networks of references via Google Scholar

14. 14 Study 2: networks of references via Google Scholar

15. 15 Study 2: networks of references via Google Scholar

16. 16 Study 2: networks of references via Google Scholar

17. Study 3: The world of arts – work in progress … 17

18. 18 Study 3: The world of arts – work in progress …

19. 19 Study 3: The world of arts – work in progress …

20. 20 Study 3: The world of arts – work in progress …

21. 21 Web Scrapping 1. Why? 2. How? 3. Case studies 4. Why not? The promises of web scrapping

22. 22 Web Scrapping: Why not ? M Scrapping is usually forbidden

23. 23 Web Scrapping: Why not ? M … but things are changing, at least in the UK http://www.slideshare.net/petermurrayrust/content-mining-at-wellcome-trust

24. 24 M Data quality issues, especially on Google Scholar? Web Scrapping: Why not ?

25. 25 M Data quality issues, especially on Google Scholar? Web Scrapping: Why not ?