arachnode.net
An open source .NET web crawler written in C# using SQL 2005/2008

Paging In Lucene.Net Search Results

rated by 0 users
Answered (Verified) This post has 1 verified answer | 6 Replies | 0 Followers

posted on 24 Dec 2009 8:27 AM


Hi,


     I am newbiee here.I am not sure whether I can post it here or not,But psoting because I am getting useful replies from this forums.Thanks for everything.

 I am using Lucene.Net to search in my website.When I am trying to search in some scenaios I am getting thousands of results.In future it may be lakhs of results. I can't show all the results in single page.Can Lucene.Net supports in paging.Can I search and get a range of results. like first 100 and later 101 to 200 like this..

Can you let me know, as soon as possible, so that if it is not possible, I may need to look for alternates.Waiting for your response.Thanks in advance.

Answered (Verified) Verified Answer

Top 10 Contributor
1,202 Posts

Yes, the SearchManager supports paging of any page size.  You could page by every 1-2 results if you wanted to...

The SearchManager supports the type of paging you want to do as well, you can mix and match like you described.

An open source .NET web crawler written in C# using SQL 2005/2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

C# crawler, C# web crawler, C# site crawler

All Replies

Top 10 Contributor
1,202 Posts

Yes, the SearchManager supports paging of any page size.  You could page by every 1-2 results if you wanted to...

The SearchManager supports the type of paging you want to do as well, you can mix and match like you described.

An open source .NET web crawler written in C# using SQL 2005/2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

C# crawler, C# web crawler, C# site crawler

Thanks for your quick reply.

I have gone through SearchManager,cs.In this we are performing Search each and every time.whenever user wants to navigate to other page.Everytime we are getting all the results and showing a set of results only based on page number.

Won't Lucene.Net itself support this kind of functionality, like Search and return results within a range like 1-10 , 11-20 .. like this. Because the searching process itself will take time to get all results.So, I am just wondering if we can get range of search results from Lucene.Net

So, can you let me know if we can do it?

Top 10 Contributor
1,202 Posts
arachnode.net replied on 24 Dec 2009 8:48 PM

I don't believe that lucene support paging internally.  The recommendation from lucene.net is to go ahead and search again, as lucene.net is fast and the internal caching is beneficial for re-searching.

Searching speed is greatly improved in Version 1.3+ FWIW.

An open source .NET web crawler written in C# using SQL 2005/2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

C# crawler, C# web crawler, C# site crawler

Thanks for your reply. Then I will use Searchmanager.cs only.

Suggested by

Well, You're probably better off using Solr, this kind of capability comes with simple query parameters, see

http://www.lucidimagination.com/search/document/CDRG_ch07_7.6?q=query%20limit

 Hope this will help you.

Cheers Smile

 

 

Yeah checked it out. Looks good.

Page 1 of 1 (7 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2004-2010, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems