These are the slides on the topic Introduction to Web Scraping using the Python 3 programming language. Topics covered are-
What is Web Scraping?
Need of Web Scraping
Real Life used cases .
Workflow and Libraries used.
2. AGENDA
What we’ll do
What is Web Scraping?
Need of Web Scraping.
Real Life Used Cases.
Workflow and Libraries used.
Demo (Scrape a Website)
Rules of Web Scraping.
3. WEB SCRAPING
What is it?
Web Scraping is a technique to fetch data and
information from websites.
Everything you see on a webpage can be
scraped.
Can be done in most programming languages,
we’ll use Python (coz its a python meetup :p).
4. NEED OF WEB SCRAPING
But I Can Just Copy/Paste the Data
What about a thousand webpages or even more.
When no API is provided or there is only limited
number of requests.
Online tools with less customizations.
Learn something new and be your own boss!
5. USAGE
Real Life Used Cases
Web Crawlers
E-Commerce price comparer.
Preparing dataset for your ML model.
Scraping Social Media Profiles.
Weather Data.
(Sky’s the limit)
6. WORKFLOW & LIBRARIES
Steps and Tools Involved
Send Request and Load the webpage.
(Requests, urllib, httplib)
Parse the content for desired data.
(Beautiful Soup, re, Scrapy)
Store the data the way you want.