arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop
Search the Live Index Does arachnode.net scale? | Download the latest release

Something about commercial license

rated by 0 users
Answered (Verified) This post has 1 verified answer | 1 Reply | 1 Follower

posted on Mon, Jan 4 2010 7:16 AM

Hi,

I'm interested in AN commercial license

Before to proceed in purchase, I have some questions...

ABOUT PURCHASE

- After the payment can I immediately download the full project (is the 1.4 version?) with sources?

- Future updates are included in this license? (for example... 1.5, 1.6, etc...). Or only the 1.4 patches?

 

ABOUT PRODUCT

- Is it possible to define something like a rule that crawls all the google search results without exiting from the link domain (for example.... google returns 2 results... the first is www.example1.com/.../../blalba.html, the second www.example2.com/../blabla.asp......etc..... I need to crawl the www.example1.com and www.example2.com domains without crawl other domains linked inside theese domains)?

  If you cannot tell me here how to solve this problem, you could tell me if is it possible.... and then when I'll buy the license maybe I'll ask you again in the "licensed" forum.

 

Thanks

 

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts

Yes, full source is included and there is no end to your license.

Yes, this is possible to achieve with a CrawlRule.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (2 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC