arachnode.net
An open source .NET web crawler written in C# using SQL 2005/2008

Start working question

rated by 0 users
Answered (Verified) This post has 1 verified answer | 3 Replies | 3 Followers

Top 25 Contributor
10 Posts
Henry.Wen posted on 30 Aug 2009 8:49 PM

Please pardon me , I would like to ask you a few stupid questions.

Now ,i want to get images,txt and so on,from the website of  http://www.ebaiy.com.

what should i edit the table of cfg.Configuration, cfg.CrawlActions and cfg.CrawlRules.

Now,the table view follows:

cfg.Configuration:

cfg.CrawlRules:

 

 cfg.CrawlAction:

thanks Mike.

Answered (Verified) Verified Answer

Top 10 Contributor
1,202 Posts

By default, arachnode.net is configured to download images.  :)

Just start crawling!

-Mike

An open source .NET web crawler written in C# using SQL 2005/2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

C# crawler, C# web crawler, C# site crawler

All Replies

Top 50 Contributor
7 Posts

Yes, if there is an example , it will be very helpful!

waiting.........................

 

Top 25 Contributor
10 Posts

I need the code help me to get images from websit right now..Because, I add the arachnode to my project.

Top 10 Contributor
1,202 Posts

By default, arachnode.net is configured to download images.  :)

Just start crawling!

-Mike

An open source .NET web crawler written in C# using SQL 2005/2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

C# crawler, C# web crawler, C# site crawler

Page 1 of 1 (4 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2004-2010, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems