[WS2] Web Scraper Multithreading Using Java with PhantomJS (CSV files and MySQL database included)
This demonstrates how to simultaneously scrape Amazon web store book categories for details such as rank, title, author and price.
Applying Multithreading to AmazonWebScraper by:
packaging the java app to an executable jar file
passing categories as arguments during execution
Sample categories are:
bestsellers for Best Sellers
new-releases for New Releases
Execution:
java -jar AmazonWebScraper.jar bestsellers new-releases
Output:
CSV files, e.g.
1. new-releases_books_2016-07-30_15-59-27.csv
2. bestsellers_books_2016-07-30_15-59-28.csv
DB entries
books.new_releases
books.best_sellers