arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop
Search the Live Index Does arachnode.net scale? | Download the latest release

Few questions about search result website and full text index

rated by 0 users
Answered (Verified) This post has 1 verified answer | 1 Reply | 2 Followers

Top 500 Contributor
1 Posts
wenduan posted on Fri, Aug 19 2016 8:29 AM

Hi,

I have few questions:

1. I have crawled about 200G web pages, how can I search the pages in the search web site? How to config it? does it need to run a service?

2. How can I enable the Lucene.net index engine and sql server full-text index engine? how can I make these engines running without running the console?

3. I want to performance of lucene.net and sql server full-text index, can I? where are the source code for lucene.net index and search, and sql server full text index and search in Arachnode.net ?

 

Thanks,

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts
Verified by arachnode.net

1.) See the instructions here: https://arachnode.net/Content/InstallationInstructions.aspx  (Set the Startup Project to 'Web' and all will work as expected)

2.) Lucene.NET indexing is enabled through the ManageLuceneDotNetIndexes.cs plugin.  The Web project loads Lucene.NET to enable searching.  https://lucenenet.apache.org/

3.) See #2.

Searching through SQL FTI is not implemented.

Thanks,
Mike 

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (2 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC