Presentation for IIIT Bangalore Hack U (http://bangalore.yahoo.com/hacku/) on getting data from the Web using YQL and Pipes.yahoo.com

1. Get me my Data ? Subramanyan Murali Web Developer, hacker, Speaker Look at various Data sources

2. Data and hacks

3. Putting something together in 24 hours can be a real rush !

4. Internet is a data exchange medium

5. Need innovative ways to make the data into information that is useful

6. Any resource on the internet is a source of data …

7. … that means that there is a lot of data 

8. Loads and loads of data and data services  !

9. Data that is complex and in many formats  !

10. Navigating through all the complexity can be hard !#$%&

11. How to solve the data problem ?

12. http://pipes.yahoo.com saves the day!

13. Graphical interface to play with data !

14. WYSIWYG = pipes

15. Predefined presentations ! RSS, JSON, Map, badge

16. Pipes is a visual tool, where is my command line ?? 

17. Put your hands up for YQL !

18. Common data access language across the web developer.yahoo.com/yql

19. SQL like syntax Standard and easy to use

20. select { what } from { service } where { condition } in ( { sub-query } )

21. Several services can be chained using in ()

22. YQL Console

23. Lots of Integrations and predefined tables anyone can be part of the interface

24. Fetching data from a resource has never been simpler  !

25. http://query.yahooapis.com/v1/ public/yql? q={query} &format={format}

26. Irrespective of the source, output can be standardized …

27. … thus giving you a solid & consistent data foundation

28. Input can be XML, HTML, CSV, micro-formats, Atom feeds, JSON, RSS

29. Output can be JSON or XML

30. Mix and match YQL and Pipes ?

31. Pipes provides you with processing capabilities

32. YQL is another feed source

33. Interlinking YQL and Pipes for innovation 

34. Happy Hacking !! Photos @ http://flickr.com/photos/rmsguhan