How to start scraping a webpage? first steps for beginners
How do you start an ETL from scratch? In this class I discuss my approach how to scan and analyze a webpage before you scrape it. This is the very first step before I start writing any code. We answer questions like:
Which tools should you use to analyze a website?
What are the "Developer Tools"?
What is the "Network Tab"?
What is the first thing you should look at when you extract data from a web page?
What is an API endpoint?
How to use an API endpoint in Python?
How to see what you scraped?
==== CLASS STARTS AT 1:10 ====
⏱ Timestamps
0:00 Intro
1:10 What do you even want?
5:40 welcome to the mainframe: The Developer Tools
11:00 Manipulating the Source Code
13:30 "Unscrapable" page with Flutter by Blazertherazer12
15:45 How to get the whole raw Source Code?
20:00 What is the Network Tab?
22:00 Where does this webpage get its data from?
26:00 API example from OpenSea Marketplace
30:00 Hands-on Example in Python
========================
If you want to learn how to become a programmer and build automated software, this video is for you. Feel free to drop them in the comments or join our socials!
========================
🙋♂️Community Discord:
/ discord
https://theselfdev.com
blog.theselfdev.com
pomo.theselfdev.com
📲 Instagram:
/ self.devs
📩 Connect with me:
Instagram - / long.integer
Twitch - / longlikeshort
Twitter - / longinteger017
BGM: • Video
Subscriber: 1029
#pythoncourse #pythonprogramming #pythontutorial