Web Scraping Using Python and Scrapy With Txt Input and CSV Output
For this demo, we'll be scraping the Top 100 books from the Amazon Web Store with pagination for the following categories
Best Sellers
New Releases
Movers and Shakers
Input is from a text file listing the URLs to be scraped.
Output is a CSV file for each category containing the scraped data formatted into the desired columns.
i.e.
| rank | title | author | price |