How to go to the next page - 03 - Python Scrapy tutorial for beginners
On our last video, we managed to get all the books URL and then extracted the data from each one. We were limited to the books on the main page, as we didn't know how to go to the next page while using Scrapy.
Until now.
In this post you will learn how to:
Navigate to the 'next page'
Solve routing problems
Extract all the data of every book available
---------------------------------
Timestamps:
00:49 - Gameplan
01:34 - Next page URL
04:28 - Solving the missing 'catalogue/' from books URL
05:38 - Solving the missing 'catalogue/' from page URL
07:52 - Conclusion
---------------------------------
Subscribe to the channel:
/ @letslearnabout4934
Text version:
https://letslearnabout.net/python/pyt...
Twitter:
/ davidmm1707
GitHub:
https://github.com/david1707