I Crawl a List Page: Such As: http://www.zhaojijiaju.com/news.asp
And It has Many sub pages : Such as: http://www.zhaojijiaju.com/view_news.asp?id=75
http://www.zhaojijiaju.com/view_news.asp?id=25
http://www.zhaojijiaju.com/view_news.asp?id=78
How I Can Do a CrawlRequest In The DataTable "dbo.CrawlRequests"??
quickly,Thanks!!!!
I am not sure I understand the question.
I think you want to submit a depth of more than 1 to crawl deeper into a website's structure.
For best service when you require assistance:
An open source .NET web crawler written in C# using SQL 2005/2008.
Twitter: http://twitter.com/arachnode_net
arachnode.net provides custom crawling and contracting resources. Please ask.
C# crawler, C# web crawler, C# site crawler