arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

General questions regarding the use of AN

rated by 0 users
Answered (Verified) This post has 1 verified answer | 2 Replies | 1 Follower

posted on Wed, Aug 25 2010 1:55 PM

I have some questions regarding the use of AN, hope someone is able to answer these

1) Can AN handle spelling errors in the search box? I can see that there are a few classes in the functions project that sound like they handle spelling errors, but I don't see where they are used and how. 2) Does AN support wildcards like +?* in a search? 3) How do I extract statistics from searches? Like: Which words were searched for? When were they searched for? How many times? etc... 4) How to use the webservice. Can you give an example? 5) Can the development license be moved from one machine to another in case of purchase of new hardware? 6) What is the correct way of searching a single website (without following external links)? TheWall

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts
Verified by arachnode.net

1.) AN doesn't provide this functionality, but if you buy a license I could be persuaded to add it.  :)

2.) Yes.  AN uses standard Lucene.net syntax.

3.) AN doesn't provide this functionality, but if you buy a license I could be persuaded to add it.  :)

4.) Yes, in a moment.

5.) Yes.

6.) Read this: http://arachnode.net/forums/t/739.aspx, and this: http://arachnode.net/forums/p/323/10294.aspx#10294 and this: http://arachnode.net/forums/p/1023/11996.aspx#11996

Thanks!
Mike

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

All Replies

Top 10 Contributor
1,905 Posts
Verified by arachnode.net

1.) AN doesn't provide this functionality, but if you buy a license I could be persuaded to add it.  :)

2.) Yes.  AN uses standard Lucene.net syntax.

3.) AN doesn't provide this functionality, but if you buy a license I could be persuaded to add it.  :)

4.) Yes, in a moment.

5.) Yes.

6.) Read this: http://arachnode.net/forums/t/739.aspx, and this: http://arachnode.net/forums/p/323/10294.aspx#10294 and this: http://arachnode.net/forums/p/1023/11996.aspx#11996

Thanks!
Mike

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
1,905 Posts

There was a breaking change in Lucene.NET that broke the service.

Here's the fix, for all those that are using the DEMO.  (I will update the DEMO soon, with the upcoming release...)

Here is what the service functionality looks like:

The parameters passed to the WebService are the same as those shown in the query strings in the Search.aspx page...

Queries showing speed:

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (3 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC