arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Browse Site by Tags

Showing related tags and posts across the entire site.
  • What am i doing wrong

    Hi, I am using AN_v1.4, and struggling to make AN work for me, I need help really bad, Scenario: I have two sites that I want to crawl (i) www.monster.com (ii) www.jobster.com They both are search engines for jobs, on their home page they allow you to enter your search string and provide you with search...
    Posted to General Questions by vishal on Thu, Jan 21 2010
  • Help Needed

    Hi, I would greatly appreciate any help, I am new to AN, i managed to get it up and running, It was actually not bad, just 4 easy steps and it's up and running, now here is what i am trying to achieve, 1) I have a list of web sites approximately 200 sites (these are job sites, job aggregators, companies...
    Posted to General Questions by vishal on Tue, Oct 6 2009
  • Re: New Issue "Deploying" and "Testing" with console.

    No worries. The biggest challenge with arachnode.net thus far seems to be installation and configuration. Believe it or not, I run into new errors from time to time that are VS related, and not related to arachnode.net at all. I use VS2005 Professional. Do you have a copy of this SKU? Can you paste the...
    Posted to General Questions by arachnode.net on Sun, Mar 29 2009
Page 1 of 1 (20 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC