arachnode.net v2.0
An open source .NET web crawler written in C# using SQL 2005/2008

crawl specific sites

rated by 0 users
Not Answered This post has 0 verified answers | 1 Reply | 2 Followers

Top 50 Contributor
3 Posts
Roel posted on 03-16-2009 2:17 AM

Hi,

First thanks for your work, it works good!!

I setup my arachnode like http://arachnode.net/forums/t/103.aspx. How do I call the crawl within the console?

Now its configured like this:

crawler.Crawl(

 

new CrawlRequest(new Discovery(http://www.nu.nl), 1, false));

But the nu.nl URI is in the database now.

Thanks!!

Roel

All Replies

Top 10 Contributor
Male
927 Posts

I am not sure I understand your question.  Can you ask it another way?

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Page 1 of 1 (2 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2009, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems