arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Browse Site by Tags

Showing related tags and posts across the entire site.
  • Few questions about search result website and full text index

    Hi, I have few questions: 1. I have crawled about 200G web pages, how can I search the pages in the search web site? How to config it? does it need to run a service? 2. How can I enable the Lucene.net index engine and sql server full-text index engine? how can I make these engines running without running...
    Posted to General Questions by wenduan on Fri, Aug 19 2016
  • What am i doing wrong

    Hi, I am using AN_v1.4, and struggling to make AN work for me, I need help really bad, Scenario: I have two sites that I want to crawl (i) www.monster.com (ii) www.jobster.com They both are search engines for jobs, on their home page they allow you to enter your search string and provide you with search...
    Posted to General Questions by vishal on Thu, Jan 21 2010
  • KeyNotFoundException

    Hi, I am getting following error in the dbo.Exceptions table, please suggest. The given key was not present in the dictionary . at System . ThrowHelper . ThrowKeyNotFoundException () at System . Collections . Generic . Dictionary`2.get_Item ( TKey key ) at Arachnode . Plugins . CrawlActions . ManageLuceneDotNetIndexes...
    Posted to General Questions by vishal on Mon, Jan 18 2010
Page 1 of 1 (20 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC