Learning to scrape in python and bs4 | A course on scraping websites in python from scratch

Published: 10 May 2022
on channel: Python Hub Studio

256,109

9.6k

Video - a training course on site scraping from scratch in the python programming language.
Let's start with simple things, write a parser using the example of collecting data from an online store and get to the magic of scraping with post authorization, writing parsing data to a table and optimizing the scraper code according to the generator principle.

00:00 python site scraping - introduction
02:37 install libraries pip install requests, beautifulsoup4, lxml
04:04 import libraries into the project
04:57 review of the HTML code of the online store page for scraping
09:15 inspecting the HTML element of the product code
10:45 write code for product scraping
16:28 BeautifulSoup find method
25:07 BeautifulSoup get method
28:00 find_all method scrape all elements of the product catalog page
31:26 scraping all pages of the product catalog
33:38 sleep - pauses between get requests
34:54 masking request headers - headers
37:32 scraping into each product card
55:27 scraper - generator, optimize the code
01:01:02 write scraping result data to exсel table
01:11:42 scraping product pictures (download)
01:12:58 requests get download file
01:22:32 scraping with POST authorization on the site

Links to websites from the video:

Site with product catalog:
https://scrapingclub.com/exercise/lis...

Website with quotes and authorization:
https://quotes.toscrape.com/

Video on working with the requests library:
• Python requests http, https запросы, ...

Video course on the python language:
• Учим python за 7 часов! Уроки Python ...

Like, subscribe, comment) If you liked the video,
and I will know that such content is of interest to you!

Watch video Learning to scrape in python and bs4 | A course on scraping websites in python from scratch online, duration hours minute second in high quality that is uploaded to the channel Python Hub Studio 10 May 2022. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 256,109 times and liked it 9.6 thousand visitors.

9,157