arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Browse Forum Posts by Tags

Showing related tags and posts for the General Questions forum. See all tags in the site
  • Re: Question about crawling Flash sites.

    WRT flash crawling - are you meaning how easy is it to crawl sites only that contain flash embeds, or do you mean how easy is it to get content out of the flash embeds? Super easy to restrict crawling to sites that are flash based - you would just use a CrawlAction to restrict crawling. AFA getting content...
    Posted to General Questions (Forum) by arachnode.net on Sun, Aug 2 2009
Page 1 of 1 (1 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC