How to SCRAPE DYNAMIC websites with Selenium

Published: 12 February 2020
on channel: John Watson Rooney

171,378

3.7k

How I use Selenium and Python to automate a browser to scrape data from dynamic websites. These sites load the content through JS or similar meaning we cannot use requests to get the html information. This is a way to get to that info.

Scraper API: https://www.scrapingbee.com/?fpr=jhnwr
Proxies I use: https://proxyscrape.com/?ref=jhnwr
Hosting: Digital Ocean (Affiliate Link) - https://m.do.co/c/c7c90f161ff6
Gear Used: https://jhnwr.com/gear/ (NEW)
Patreon: / johnwatsonrooney (NEW)

Watch video How to SCRAPE DYNAMIC websites with Selenium online, duration hours minute second in high quality that is uploaded to the channel John Watson Rooney 12 February 2020. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 171,378 times and liked it 3.7 thousand visitors.