An overview of some advanced Crawlbot techniques for data extraction and web spidering. This shows how to limit/narrow your crawl within a site, for instance to only extract product data from an e-commerce site.
Links:
http://support.diffbot.com
http://www.diffbot.com/dev/docs/crawl