arachnode.net v2.0
An open source .NET web crawler written in C# using SQL 2005/2008
Forums » arachnode.net » General Questions » Crawl URL Question

Crawl URL Question

rated by 0 users
Not Answered This post has 0 verified answers | 1 Reply | 2 Followers

Top 25 Contributor
8 Posts
TileCheng posted on 02-17-2009 10:10 PM

I Crawl  it  :  http://www.zhaojijiaju.com/news.asp

and Crawl  it's  SubPage  Infomation   http://www.zhaojijiaju.com/view_news.asp?id=75,

I will  Insert  What Data  To  DataTable  "CrawlRequests"??

Now I Do  :Absoluteuri: http://www.zhaojijiaju.com/news.asp,   depth:4,   restricttourihost:true;   priority:1

 

How  You Do??? thanks

All Replies

Top 10 Contributor
Male
925 Posts
Reply
arachnode.net replied on 05-26-2009 8:29 PM

This is correct.

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Page 1 of 1 (2 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2009, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems