Harvest-NG is a Perl-based set of tools for building a standards-compliant web crawler.
More information about them, from the website:
Harvest-NG is a set of tools for building a standards-compliant web crawler. It is implemented in Perl, taking advantage of many of the existing perl tools, and can provide a complete harvesting solution for a web site.
Visit Harvest-NG
Highly Recommended for All Web Publishers:
Are you a publisher or advertiser looking for the right internet advertising network? Check out our overviews of interactive marketing providers, including online ad networks such as Tribal Fusion, ValueClick, Adconion, Casale Media, and dozens more. We cover display advertising networks, text-based advertising, contextual ads, viral, pre-roll video, mobile, in-image advertising, performance networks, and everything else in the internet advertising realm. Click here for the complete list of internet advertising networks.
Reviews of selected top internet advertising networks:
