SlideShare une entreprise Scribd logo
1  sur  11
Using Yahoo Pipes to access data from web pages THATCamp Canberra 2011
Why Yahoo Pipes? Browsers impose same-domain restriction on requesting XML/HTML/CSV content to include in web pages We can use server side technologies to retrieve data from external sources, but what about when we don’t have access to those technologies? (e.g. embedding content in a blog post)  Yahoo Pipes convert data sources to JSON (JavaScript Object Notation) which can be included via JavaScript on web pages without restrictions  http://pipes.yahoo.com
Example mashup
convictbook data sources Trove People & Organisations SLQ convict data Web page : hosted within a Content Management System  (HTML + CSS  + JavaScript + jQuery) CSV SRU Query Result (XML) Google Refine (Data clean up) Yahoo Pipes CSV JSON Visualisation links JSON Yahoo Pipes Google  FusionTables Query (XML) CSV Picture Australia data
Pipe : Trove People by name http://pipes.yahoo.com/pipes/pipe.info?_id=eed133e99c38a68d20d279e46cee66e6
Yahoo Pipes
JSON { "count" : 1,     "value" : {         "title" : "ConvictIDGet",         "description" : "Pipes Output",         "link" : "http:pipes.yahoo.compipespipe.info?_id=c8b70fd9d9f6edcfbb7c0e351992e717",         "pubDate" : "Thu, 06 Oct 2011 22:49:50 -0700",         "generator" : "http:pipes.yahoo.compipes",         "callback" : "",         "items" : [{             "convictid" : "200",             "name" : "Frederick Beadle",             "one_of" : "one of 296 convicts transported on the Pyrenees",             "convicted" : "Central Criminal Court",             "term_duration" : "10 years",             "conviction_date" : "",             "notes" : "Ticket of Leave.",             "vessel" : "Pyrenees",             "departure_date" : "31 January 1853",             "destination" : "Western Australia",             "microfilmref" : "Australian Joint Copying Project. Microfilm Roll 93, Class and Piece Number HO1118, Page Number 3 (3)",             "surname" : "Beadle",             "given_names" : "Frederick",             "y:row" : "2",             "description" : null,             "title" : null         }] }} Tip: Use http://jsonlint.com/ to  validate and format JSON
JSON for Trove People query {     "count" : 1,     "value" : {         "title" : "TrovePeople",         "description" : "Pipes Output",         "link" : "http:pipes.yahoo.compipespipe.info?_id=c3412dfcaf40a54bdcd0273b293174e5",         "pubDate" : "Thu, 06 Oct 2011 22:50:47 -0700",         "generator" : "http:pipes.yahoo.compipes",         "callback" : "",         "items" : [{             "xmlns" : "http:www.loc.govzingsrw",             "version" : "1.1",             "numberOfRecords" : "265",             "resultSetId" : "kc2umf",             "resultSetIdleTime" : "300",             "records”:  {"record" : [{ "recordSchema" : "http:www.w3.org2005Atom", "recordPacking" : "xml", "recordData" : { "entry" : { "id" : "http:nla.gov.aunla.party-529154", "link" : [{ "href" : "http:nla.gov.aunla.party-529154” }, { "href" : "http:nla.gov.auanbd.aut-an35513577", "rel" : "related” }, { "href" : "http:www.adb.online.anu.edu.aubiogsA100015b.htm",  "rel" : "related”}], "author" : { "name" : "National Library of Australia Party Infrastructure”}, "published" : "2008-12-10T15:20:01Z", "title" : "Lawson, H. S. W.", "content" : { "type" : "textplain", "content" : "Alternate names: Lawson, Harry Sutherland Wightman; Lawson, Harry Sutherland Wightman, Sir” }}},  "recordPosition" : "1” },  … }]}}
Including JSON data using jQuery Live example: http://jsfiddle.net/AnnaGerber/cbJrc/ <html><head><title>Demo</title></head> <script type=“text/javascript” src=“jQuery.js”></script> <script type="text/javascript">  function findPeople(pName) {     varurl = "http://pipes.yahoo.com/pipes/pipe.run?_id=eed133e99c38a68d20d279e46cee66e6&_render=json&name=" + pName;     $.getJSON( url, function( data ) {         varoutputHTML = "”;         $.each(data.value.items[0].records.record, function( index,item ) {              var record=item.recordData.entry;             outputHTML += "<li><a target='_blank' href='”  + record.link[0].href  +"'>"                + record.title   + "</a></li>";         });         $('#output').html(outputHTML);      }); }); $(document).ready(function(){ findPeople(‘Lawson’);  }); </script></head><body> <h1>People</h1> <ul id=“output"></ul> </body></html> Tip: use browser inspector + console.log() to inspect data

Contenu connexe

Tendances

زُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِزُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِDr. GM Sherbini
 
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsHebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsDirk Roorda
 
History of Computer Hindi Notes
History of Computer Hindi NotesHistory of Computer Hindi Notes
History of Computer Hindi NotesSirajRock
 
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue1616 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16Akhil Bharat Mahasabha
 
3 9 july 17 final pdf for print
3 9 july 17 final pdf for print3 9 july 17 final pdf for print
3 9 july 17 final pdf for printsnehalcnp
 
19 january to 25 january 2015 12 18 nav. 12
19 january to 25  january 2015 12 18 nav. 1219 january to 25  january 2015 12 18 nav. 12
19 january to 25 january 2015 12 18 nav. 12snehalcnp
 

Tendances (10)

Bachelor Diploma.PDF
Bachelor Diploma.PDFBachelor Diploma.PDF
Bachelor Diploma.PDF
 
Aap manifesto delhi power
Aap manifesto delhi powerAap manifesto delhi power
Aap manifesto delhi power
 
زُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِزُبَرَ الْحَدِيدِ و الْقِطْرِ
زُبَرَ الْحَدِيدِ و الْقِطْرِ
 
Hebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, LessonsHebrew Bible as Data: Laboratory, Sharing, Lessons
Hebrew Bible as Data: Laboratory, Sharing, Lessons
 
Apn log
Apn logApn log
Apn log
 
History of Computer Hindi Notes
History of Computer Hindi NotesHistory of Computer Hindi Notes
History of Computer Hindi Notes
 
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue1616 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
16 july-2014 to-22-july-2014-hindu_sabhavarta_year38_issue16
 
3 9 july 17 final pdf for print
3 9 july 17 final pdf for print3 9 july 17 final pdf for print
3 9 july 17 final pdf for print
 
19 january to 25 january 2015 12 18 nav. 12
19 january to 25  january 2015 12 18 nav. 1219 january to 25  january 2015 12 18 nav. 12
19 january to 25 january 2015 12 18 nav. 12
 
TRB323_023-RR
TRB323_023-RRTRB323_023-RR
TRB323_023-RR
 

Similaire à Using Yahoo Pipes to access web data in 40 chars or less

External Data Access with jQuery
External Data Access with jQueryExternal Data Access with jQuery
External Data Access with jQueryDoncho Minkov
 
Couch Db.0.9.0.Pub
Couch Db.0.9.0.PubCouch Db.0.9.0.Pub
Couch Db.0.9.0.PubYohei Sasaki
 
Illuminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 TutorialIlluminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 Tutorialmikel_maron
 
Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Tatsuhiko Miyagawa
 
Grddl In A Nutshell V1
Grddl In A Nutshell V1Grddl In A Nutshell V1
Grddl In A Nutshell V1Fabien Gandon
 
Adding timezones into Upcoming feeds
Adding timezones into Upcoming feedsAdding timezones into Upcoming feeds
Adding timezones into Upcoming feedsMatt Harris
 
REST, the internet as a database?
REST, the internet as a database?REST, the internet as a database?
REST, the internet as a database?Andrej Koelewijn
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)Joel Lord
 
Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)MongoSF
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)Joel Lord
 
A brief history of the web
A brief history of the webA brief history of the web
A brief history of the webJorge Zapico
 
Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”dhammasociety
 
Web 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesWeb 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesAmbles Kwok
 
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4Dimitris Psounis
 
Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Mark Wubben
 
FOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedFOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedDan Theurer
 
Ledtalks vsl lighting
Ledtalks vsl lightingLedtalks vsl lighting
Ledtalks vsl lightingRolandSyntens
 

Similaire à Using Yahoo Pipes to access web data in 40 chars or less (20)

External Data Access with jQuery
External Data Access with jQueryExternal Data Access with jQuery
External Data Access with jQuery
 
JSON Viewer XPATH Workbook
JSON Viewer XPATH WorkbookJSON Viewer XPATH Workbook
JSON Viewer XPATH Workbook
 
Couch Db.0.9.0.Pub
Couch Db.0.9.0.PubCouch Db.0.9.0.Pub
Couch Db.0.9.0.Pub
 
Illuminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 TutorialIlluminated Hacks -- Where 2.0 101 Tutorial
Illuminated Hacks -- Where 2.0 101 Tutorial
 
Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8Web Scraper Shibuya.pm tech talk #8
Web Scraper Shibuya.pm tech talk #8
 
Grddl In A Nutshell V1
Grddl In A Nutshell V1Grddl In A Nutshell V1
Grddl In A Nutshell V1
 
Adding timezones into Upcoming feeds
Adding timezones into Upcoming feedsAdding timezones into Upcoming feeds
Adding timezones into Upcoming feeds
 
REST, the internet as a database?
REST, the internet as a database?REST, the internet as a database?
REST, the internet as a database?
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
 
Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)Schema design with MongoDB (Dwight Merriman)
Schema design with MongoDB (Dwight Merriman)
 
I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)I Don't Care About Security (And Neither Should You)
I Don't Care About Security (And Neither Should You)
 
A brief history of the web
A brief history of the webA brief history of the web
A brief history of the web
 
Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”Preview Of “Preparation Tipitaka Recitation 2008 ”
Preview Of “Preparation Tipitaka Recitation 2008 ”
 
Web 2.0 &amp; Search Engines
Web 2.0 &amp; Search EnginesWeb 2.0 &amp; Search Engines
Web 2.0 &amp; Search Engines
 
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
ΠΛΗ20 ΤΥΠΟΛΟΓΙΟ ΕΝΟΤΗΤΑΣ 4
 
Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>Bringing Typography to the Web with sIFR 3 at <head>
Bringing Typography to the Web with sIFR 3 at <head>
 
FOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy AppliedFOWA 09 - Open Strategy Applied
FOWA 09 - Open Strategy Applied
 
Yahoo - Open Applied
Yahoo - Open AppliedYahoo - Open Applied
Yahoo - Open Applied
 
Ledtalks vsl lighting
Ledtalks vsl lightingLedtalks vsl lighting
Ledtalks vsl lighting
 
HTML5 Web Forms
HTML5 Web FormsHTML5 Web Forms
HTML5 Web Forms
 

Plus de Anna Gerber

Internet of Things (IoT) Intro
Internet of Things (IoT) IntroInternet of Things (IoT) Intro
Internet of Things (IoT) IntroAnna Gerber
 
How the Web works
How the Web worksHow the Web works
How the Web worksAnna Gerber
 
Do you want to build a robot
Do you want to build a robotDo you want to build a robot
Do you want to build a robotAnna Gerber
 
"Serverless" express
"Serverless" express"Serverless" express
"Serverless" expressAnna Gerber
 
Adding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAdding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAnna Gerber
 
3D Printing Action Heroes
3D Printing Action Heroes3D Printing Action Heroes
3D Printing Action HeroesAnna Gerber
 
3D Sculpting Action Heroes
3D Sculpting Action Heroes3D Sculpting Action Heroes
3D Sculpting Action HeroesAnna Gerber
 
International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)Anna Gerber
 
JavaScript Robotics
JavaScript RoboticsJavaScript Robotics
JavaScript RoboticsAnna Gerber
 
Intro to Electronics in Python
Intro to Electronics in PythonIntro to Electronics in Python
Intro to Electronics in PythonAnna Gerber
 
Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Anna Gerber
 
Supporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationSupporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationAnna Gerber
 
Supporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationSupporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationAnna Gerber
 
Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Anna Gerber
 
Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Anna Gerber
 
Intro to data visualisation
Intro to data visualisationIntro to data visualisation
Intro to data visualisationAnna Gerber
 
Annotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnnotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnna Gerber
 
Getting started with the Trove API
Getting started with the Trove APIGetting started with the Trove API
Getting started with the Trove APIAnna Gerber
 

Plus de Anna Gerber (20)

Internet of Things (IoT) Intro
Internet of Things (IoT) IntroInternet of Things (IoT) Intro
Internet of Things (IoT) Intro
 
How the Web works
How the Web worksHow the Web works
How the Web works
 
Do you want to build a robot
Do you want to build a robotDo you want to build a robot
Do you want to build a robot
 
"Serverless" express
"Serverless" express"Serverless" express
"Serverless" express
 
Iot 101
Iot 101Iot 101
Iot 101
 
Adding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action HeroesAdding Electronics to 3D Printed Action Heroes
Adding Electronics to 3D Printed Action Heroes
 
3D Printing Action Heroes
3D Printing Action Heroes3D Printing Action Heroes
3D Printing Action Heroes
 
3D Sculpting Action Heroes
3D Sculpting Action Heroes3D Sculpting Action Heroes
3D Sculpting Action Heroes
 
International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)International NodeBots Day Brisbane roundup (BrisJS)
International NodeBots Day Brisbane roundup (BrisJS)
 
JavaScript Robotics
JavaScript RoboticsJavaScript Robotics
JavaScript Robotics
 
Intro to Electronics in Python
Intro to Electronics in PythonIntro to Electronics in Python
Intro to Electronics in Python
 
Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)Data Visualisation Workshop (GovHack Brisbane 2014)
Data Visualisation Workshop (GovHack Brisbane 2014)
 
Supporting Open Scholarly Annotation
Supporting Open Scholarly AnnotationSupporting Open Scholarly Annotation
Supporting Open Scholarly Annotation
 
Supporting Web-based Scholarly Annotation
Supporting Web-based Scholarly AnnotationSupporting Web-based Scholarly Annotation
Supporting Web-based Scholarly Annotation
 
Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)Annotations Supporting Scholarly Editing (OA European Roll Out)
Annotations Supporting Scholarly Editing (OA European Roll Out)
 
Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)Annotation Tools (OA European Roll Out)
Annotation Tools (OA European Roll Out)
 
Intro to data visualisation
Intro to data visualisationIntro to data visualisation
Intro to data visualisation
 
Annotations Supporting Scholarly Editing
Annotations Supporting Scholarly EditingAnnotations Supporting Scholarly Editing
Annotations Supporting Scholarly Editing
 
Getting started with the Trove API
Getting started with the Trove APIGetting started with the Trove API
Getting started with the Trove API
 
Intro to Java
Intro to JavaIntro to Java
Intro to Java
 

Dernier

What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 

Dernier (20)

What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 

Using Yahoo Pipes to access web data in 40 chars or less

  • 1. Using Yahoo Pipes to access data from web pages THATCamp Canberra 2011
  • 2. Why Yahoo Pipes? Browsers impose same-domain restriction on requesting XML/HTML/CSV content to include in web pages We can use server side technologies to retrieve data from external sources, but what about when we don’t have access to those technologies? (e.g. embedding content in a blog post) Yahoo Pipes convert data sources to JSON (JavaScript Object Notation) which can be included via JavaScript on web pages without restrictions http://pipes.yahoo.com
  • 4.
  • 5. convictbook data sources Trove People & Organisations SLQ convict data Web page : hosted within a Content Management System (HTML + CSS + JavaScript + jQuery) CSV SRU Query Result (XML) Google Refine (Data clean up) Yahoo Pipes CSV JSON Visualisation links JSON Yahoo Pipes Google FusionTables Query (XML) CSV Picture Australia data
  • 6. Pipe : Trove People by name http://pipes.yahoo.com/pipes/pipe.info?_id=eed133e99c38a68d20d279e46cee66e6
  • 8.
  • 9. JSON { "count" : 1, "value" : { "title" : "ConvictIDGet", "description" : "Pipes Output", "link" : "http:pipes.yahoo.compipespipe.info?_id=c8b70fd9d9f6edcfbb7c0e351992e717", "pubDate" : "Thu, 06 Oct 2011 22:49:50 -0700", "generator" : "http:pipes.yahoo.compipes", "callback" : "", "items" : [{ "convictid" : "200", "name" : "Frederick Beadle", "one_of" : "one of 296 convicts transported on the Pyrenees", "convicted" : "Central Criminal Court", "term_duration" : "10 years", "conviction_date" : "", "notes" : "Ticket of Leave.", "vessel" : "Pyrenees", "departure_date" : "31 January 1853", "destination" : "Western Australia", "microfilmref" : "Australian Joint Copying Project. Microfilm Roll 93, Class and Piece Number HO1118, Page Number 3 (3)", "surname" : "Beadle", "given_names" : "Frederick", "y:row" : "2", "description" : null, "title" : null }] }} Tip: Use http://jsonlint.com/ to validate and format JSON
  • 10. JSON for Trove People query { "count" : 1, "value" : { "title" : "TrovePeople", "description" : "Pipes Output", "link" : "http:pipes.yahoo.compipespipe.info?_id=c3412dfcaf40a54bdcd0273b293174e5", "pubDate" : "Thu, 06 Oct 2011 22:50:47 -0700", "generator" : "http:pipes.yahoo.compipes", "callback" : "", "items" : [{ "xmlns" : "http:www.loc.govzingsrw", "version" : "1.1", "numberOfRecords" : "265", "resultSetId" : "kc2umf", "resultSetIdleTime" : "300", "records”: {"record" : [{ "recordSchema" : "http:www.w3.org2005Atom", "recordPacking" : "xml", "recordData" : { "entry" : { "id" : "http:nla.gov.aunla.party-529154", "link" : [{ "href" : "http:nla.gov.aunla.party-529154” }, { "href" : "http:nla.gov.auanbd.aut-an35513577", "rel" : "related” }, { "href" : "http:www.adb.online.anu.edu.aubiogsA100015b.htm", "rel" : "related”}], "author" : { "name" : "National Library of Australia Party Infrastructure”}, "published" : "2008-12-10T15:20:01Z", "title" : "Lawson, H. S. W.", "content" : { "type" : "textplain", "content" : "Alternate names: Lawson, Harry Sutherland Wightman; Lawson, Harry Sutherland Wightman, Sir” }}}, "recordPosition" : "1” }, … }]}}
  • 11. Including JSON data using jQuery Live example: http://jsfiddle.net/AnnaGerber/cbJrc/ <html><head><title>Demo</title></head> <script type=“text/javascript” src=“jQuery.js”></script> <script type="text/javascript">  function findPeople(pName) {     varurl = "http://pipes.yahoo.com/pipes/pipe.run?_id=eed133e99c38a68d20d279e46cee66e6&_render=json&name=" + pName;     $.getJSON( url, function( data ) {         varoutputHTML = "”;         $.each(data.value.items[0].records.record, function( index,item ) {              var record=item.recordData.entry;            outputHTML += "<li><a target='_blank' href='”  + record.link[0].href  +"'>"               + record.title   + "</a></li>";         });         $('#output').html(outputHTML);     }); }); $(document).ready(function(){ findPeople(‘Lawson’); }); </script></head><body> <h1>People</h1> <ul id=“output"></ul> </body></html> Tip: use browser inspector + console.log() to inspect data