arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release
arachnode.net 1.0 is rapidly approaching...

Yes, it's true.  arachnode.net 1.0 will be ready in 2 weeks or less.

Notables:

  • lucene.net integration.
  • A Web project to search crawled content.
  • 100% increase in crawling performance over 0.9 beta.
  • Performance counters.

Posted Thu, Dec 25 2008 10:15 AM by arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC