arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Browse Forum Posts by Tags

Showing related tags and posts for the Forums application. See all tags in the site
  • Feature Request

    Hi Mike, This is a nice to have feature, and I feel it would help all AN users, wish this will be on the confirmed feature list soon. "Tool to configure AN using a web GUI, the tool has to be simple and intutive" ~Vishal
    Posted to Feature Requests (Forum) by vishal on Thu, Jan 21 2010
  • Disallowed Directories

    Hi Mike, Following our conversation, I think it might be a good idea to add the feature to limit the crawl to a specific Directory. For example - If I have a crawl request with "http://edition.cnn.com/US/" as URI, I will want only results from this directory down (i.e http://edition.cnn.com...
    Posted to Feature Requests (Forum) by Anat on Sun, Dec 13 2009
  • Enable Lucene Explain Feature For Debugging

    Make the Lucene explain feature available so that if desired, from the search results (or any code that is using the lucene index data), the text and/or html format of the explain output would be available to explain how a document score was calculated.
    Posted to Feature Requests (Forum) by Kevin on Mon, May 4 2009
  • Web Admin Console

    Hey I wanted to capture some thoughts for discussion as I'm thinking through a web console for arachnode. I'll capture here until we build anything else (road map and such). Some features might be specific to certain ideas I have and some more general. So we'd need to think through everything...
    Posted to Feature Requests (Forum) by Kevin on Sun, Feb 22 2009
  • arachnode.net Documentation

    Where Have arachnode.net Documentation´╝č --Thanks
    Posted to Feature Requests (Forum) by TileCheng on Wed, Feb 18 2009
  • How Close A Crawl Application ?

    I Write a Crawl Test Console Application. Now,How I Can Know The Crawl Application End? And When ? Do Have a Common Method ? Thank s.....
    Posted to Feature Requests (Forum) by TileCheng on Wed, Feb 18 2009
  • Update the Exceptions reporting views...

    The Exceptions reporting views to use the legacy method for reporting Uri classification. See: [arachnode_rvw_Exceptions_COUNT_BY_DOMAIN1] The Exception reporting views should use: arachnode_rvw_Domains_Extensions_Hosts_Discoveries_ALL
    Posted to Feature Requests (Forum) by arachnode.net on Sat, Jan 10 2009
  • Feature Requests

    Add the ability to crawl a file system. Investigate adding a central database string configuration parameter. (Done.) Verify the names of the Foreign Keys. A few of them may have been changed to less than perfect names when you enabled incremental updating for the reporting views.
    Posted to Feature Requests (Forum) by arachnode.net on Thu, Dec 25 2008
Page 1 of 1 (8 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC