Here we go through how to use requests to POST the login information and session to make it persistent, allowing us to scrape information behind a login wall.
Dummy site: https://the-internet.herokuapp.com/login
-------------------------------------
Patreon: / johnwatsonrooney
Scraper API I use: https://www.scrapingbee.com/?fpr=jhnwr
Proxies: https://iproyal.club/JWR50
Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6
Gear I use: https://www.amazon.co.uk/shop/johnwat...
Twitter / jhnwr
Watch video Web Scrape Websites with a LOGIN - Python Basic Auth online, duration hours minute second in high quality that is uploaded to the channel John Watson Rooney 22 January 2020. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 144,930 times and liked it 2.6 thousand visitors.