http://www.inspyder.com/blog/web-scra...
Website scraper software often gets a bad name as being used for unethical purposes by spammers. However, we used our Power Search web scraper to solve a problem for a client who needed to find out how many subdomains they had for a particular website.
This is a nice real world example of how you can use a website scraper to solve problems for your business. In order to keep our client's website confidential, we demonstrate in this video using Yahoo.com.
We put in a query designed to collect the subdomain info for us. Power Search then conveniently exports to Excel - and we sent out customer the list of domains that they needed to backup with our Web2Disk product.
Do you know how many subdomains Yahoo has? Using Power Search, it only took us about 18 seconds to find out!
Check out the full case study on our blog:
http://www.inspyder.com/blog/web-scra...