arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Browse Forum Posts by Tags

Showing related tags and posts for the arachnode.net group. See all tags in the site
  • List of Questions

    Ok. Almost completely up and running with VS2008 and SQL2008. Here are a few questions that I can't seem to track down myself. How do I stop the system from crawling crawling arachnode.net along with whatever I specify? I love you guys but I can only crawl the site so many times. What's the best...
    Posted to General Questions (Forum) by Jay Stevens on Fri, May 15 2009
  • arachnode.net compare with some other crawler written in Java

    I found that there is little crawler written in C# ,what about the 'arachnode.net' compare with some other crawler written in Java like nutch or heritrix.and what role the sql 2005 playing in 'arachnode.net' and can you tell me some other crawler written in C# and how can I learn the...
    Posted to General Questions (Forum) by cyj1988jyc on Fri, May 15 2009
  • How to Convert the project to a WindowsApplication??

    Until now the arachnode.net is a consoleApplication,and it is not easy to use for crawl the website,eg. we have to change the target URI by changing the souce code and compile the whole project once again. So I decide to convert the project into a windowsApplication.Maybe it better to use.Is it easy...
    Posted to General Questions (Forum) by wumengge on Tue, Apr 21 2009
  • How to Begin my web crawler and build the Index?

    I have installed all the part of the arachnode.net 1.1,and complie the whole project without any Errors. However ,I am puzzled that how to use arachnode,net. There are so many files in the folder,but where is the entry of the builded project? Is there any windows in the project , or this is only a console...
    Posted to General Questions (Forum) by wumengge on Tue, Apr 14 2009
  • Which is the necessary part for the Installation of arachnode.net ?

    There are so many steps of the arachnode.net 's Installation, I just would like to know the effect of the software which is mentioned in the Installation Instructions. eg. TortoiseSVN &Visual Studio 2005 Team Suite Service Pack 1 I never heard them ever before,so what is the function of them...
    Posted to General Questions (Forum) by wumengge on Tue, Apr 14 2009
  • Re: Quick Questions / Thoughts

    Hey! Glad to see you back! I still have to finish answering your post on how crawl priority influences search result relevancy. :) And, another user, jaydeep is really interested in the product too, so I've been working hard a getting a release together. (and, we're trying to buy a second home...
    Posted to General Questions (Forum) by arachnode.net on Fri, Feb 13 2009
Page 1 of 1 (6 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC