arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Browse Site by Tags

Showing related tags and posts across the entire site.
  • How to Convert the project to a WindowsApplication??

    Until now the arachnode.net is a consoleApplication,and it is not easy to use for crawl the website,eg. we have to change the target URI by changing the souce code and compile the whole project once again. So I decide to convert the project into a windowsApplication.Maybe it better to use.Is it easy...
    Posted to General Questions by wumengge on Tue, Apr 21 2009
  • Re: How to Begin my web crawler and build the Index?

    The first part, about not receiving any compilation errors is great news! ;) arachnode.net is currently meant to be used as a service (always on) or as class library. A Console project is provided to help with stepping through the code. A Web Admin interface is in development, but we do not have a release...
    Posted to General Questions by arachnode.net on Tue, Apr 14 2009
Page 1 of 1 (20 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC