Web Scraping Drop Down Menus | How to get option values using Python | Scrapy and bs4 Beautiful Soup

Published: 15 December 2020
on channel: Python 360
18,230
126

1 x BeautifulSoup example of Scraping dropdown option values with Python
1 x Scrapy example of Scraping dropdown option values with Python

Chapter Times #
0:00 Intro
0:42 Stack overflow question
1:33 Scrapy shell
2:18 response.xpath('//select/option/text()')
2:45 too much info
3:38 better xpath selector
4:52 BeautifulSoup - dropdowns
8:36 soup.seclect('option[value]')
10:30 list of integers

🌏 code : https://github.com/RGGH/Misc/blob/mas...
🌏 stackoverflow post : https://stackoverflow.com/questions/5...

Visit redandgreen blog for more Tutorials
=========================================
🌏 http://redandgreen.co.uk/about/blog/

Subscribe to the YouTube Channel
=================================
🌏    / drpicode  

Follow on Twitter - to get notified of new videos
=================================================
🌏   / rngweb  

Buy Dr Pi a coffee (or Tea)
☕ https://www.buymeacoffee.com/DrPi

Thumbs up yeah? (cos Algos..)

#webscraping #tutorials #python


Watch video Web Scraping Drop Down Menus | How to get option values using Python | Scrapy and bs4 Beautiful Soup online, duration hours minute second in high quality that is uploaded to the channel Python 360 15 December 2020. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 18,230 times and liked it 126 visitors.