Web Scraping Tech Stack for 2020: secrets you can't afford to miss
The internet has changed a lot in the last few years. It's becoming increasingly difficult to extract web data at scale. Watch this talk from Ondra Urban, lead maintainer of Apify SDK, to find out about the latest web scraping tools and technology. Learn how to disguise your bots by emulating browser headers, use a proper request queue, apply filters, and deal with JavaScript links. Once you have your scrapers working, find out how to scrape at scale by using proxy servers to split the load. Going beyond web scraping, learn about robotic process automation (RPA) with Puppeteer and Playwright. Finally, Ondra will explain why it's often easiest to use API scraping whenever you can.
Apify SDK: https://sdk.apify.com/
#webscraping #scrapingtips
Facebook: https://fb.com/apifytech
Twitter: / apify
Github: https://github.com/apify
Instagram: / apifytech