crawl specific sites

3 Posts

Roel posted on 16 Mar 2009 2:17 AM

Hi,

First thanks for your work, it works good!!

I setup my arachnode like http://arachnode.net/forums/t/103.aspx. How do I call the crawl within the console?

Now its configured like this:

crawler.Crawl(

new CrawlRequest(new Discovery(http://www.nu.nl), 1, false));

But the nu.nl URI is in the database now.

Thanks!!

Roel

1,244 Posts

arachnode.net replied on 26 May 2009 8:30 PM

I am not sure I understand your question. Can you ask it another way?

For best service when you require assistance:

An open source .NET web crawler written in C# using SQL 2005/2008.

arachnode.net provides custom crawling and contracting resources. Please ask.

C# crawler, C# web crawler, C# site crawler

Previous | Next

Page 1 of 1 (2 items) | RSS