How to scrape INFINITE scrolling pages using Python and Selenium (2 Methods)
In this video i show you how to scrape infinite scrolling pages using Python and Selenium with 2 different methods. Knowing how to scrape infinite scrolling pages takes you one step further in your python web scraping journey. Twitter is one example where you need Selenium to scrape infinite scrolling pages. The first method uses the execute_script function in selenium and the second one uses the send_keys function.
If you have any questions about scraping infinite scrolling pages, feel free to leave a comment down below.