How to web scrape with Python | Scraping websites with Python Requests, Beautiful Soup, and Selenium

Опубликовано: 05 Октябрь 2024
на канале: Alfredo Sequeida
948
39

Sometimes when you want to build a program, you need access to data that you don't have. Using a combination of the requests and beautiful soup libraries, we can get that data from websites online. In this video, we will go over the things that you need to know to get started web scraping using Python such as learning HTML and using the web developer tools to facilitate your work. I also talk about how you should change the method for web scraping using the requests_html library or Selenium when you encounter websites that use a lot of JavaScript as is common with single-page web applications (SPAs) and other sites that use JavaScript to dynamically load HTML content.

code snippets in this video: https://github.com/AlfredoSequeida/Yo...

Learn HTML: https://developer.mozilla.org/en-US/d...

Follow me on social: https://alfredo.lol/social

Music:
Music by Ryan Little - Holy Water - https://thmatc.co/?l=5BB2CC9F
Music by Ryan Little - Winter's Arrival - https://thmatc.co/?l=30AB7BB6

00:00​ - Why you should learn web scraping
00:38​ - Why you need to learn HTML
01:49 - Using the web developer tools
02:49 - Using Requests and Beautiful Soup
03:29 - Dealing with JavaScript
04:29 - A word of caution
05:21 - Watch more!


#python #webscraping #code

Gear:
📷 Canon EOS Rebel T7i
💻 Intel i7 XPS 13 16GB RAM (Arch Linux)