I Crawl it : http://www.zhaojijiaju.com/news.asp
and Crawl it's SubPage Infomation http://www.zhaojijiaju.com/view_news.asp?id=75,
I will Insert What Data To DataTable "CrawlRequests"??
Now I Do :Absoluteuri: http://www.zhaojijiaju.com/news.asp, depth:4, restricttourihost:true; priority:1
How You Do??? thanks
This is correct.
For best service when you require assistance:
An open source .NET web crawler written in C# using SQL 2005/2008.
Twitter: http://twitter.com/arachnode_net
arachnode.net provides custom crawling and contracting resources. Please ask.
C# crawler, C# web crawler, C# site crawler