arachnode.net v2.0
An open source .NET web crawler written in C# using SQL 2005/2008

Just trying to share!

rated by 0 users
Answered (Verified) This post has 1 verified answer | 2 Replies | 2 Followers

Top 50 Contributor
4 Posts
dinglehopper posted on 10-27-2009 5:41 PM

Sekhol Finder by Sekhol Technologies

A tool for automating deep searches on the Internet. Combines web crawler functionality with advanced keywords text search and logical analysis of a document layout. Starts with consulting main search engines and then proceeds downloading pages using the links in the meaningful part of the relevant documents. The visited pages with summaries and thumbnail images are available for instant offline preview saving a lot of time for a user

search crawler bot keywords automation marketing personal web search robotautomating deep searches internet 

site software

URL Spider Pro by Innerprise

URL Spider Pro is designed for creating a Google/AltaVista style topic specific search engine for your Web site. You simply tell it what type of information it should index and it will go through the Web collecting only documents containing that information. With URL Spider Pro, you can create a search engine for any topic, no matter how specific.

site search engine research portal spider crawl index database web web crawlersearch engine indexing site web 

email software

Fax Spider by Rebrand Software, LLC

Harvest fax numbers from the net using this Fax Spider, which finds fax numbers that are targeted by utilizing the Google and Yahoo search engines. Finds thousands of fax numbers an hour, which makes scanning for vulnerabilities easy!

email fax number spider crawler robot harvest web crawler web spider web robot 

 coldfusion software

STS Web Crawler by SofTex Solutions

If you develop web pages for a living, this tool is for you! Trace links throughout your site. Browse and edit files on the fiy. And, if you're a ColdFusion developer the STS Web Crawler will make managing your pages a snap with lookups for cfincludes, cflocations, cfqueries, and even cfstoredprocs. The STS Web Crawler can even harvest all the unique items (links, images, cfincludes, etc.) for any branch of your site.

coldfusion cf cold fusion internet links images trace sts softex solutions 

orphan analaysis software

Inspyder OrFind by Inspyder Software Inc.

Inspyder OrFind is a powerful webserver cleanup and monitoring tool. If you''ve ever wanted to know which files on your webserver are actually used by your website, the answer is here. OrFind crawls your site looking for all included files (even those included through CSS), it then checks your FTP server or a local directory for orphans. OrFind can delete the orphans with the click of a button or export the results to a customizable HTML report.

orphan analaysis orphan page finder orphaned file finder server cleanup website cleanup remove unused files unused file 

web spider software

Web Scraper Lite by Velocityscape

Eliminate cut and paste! Web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, govt. databases, real estate listings. Our easiest product yet! Creating your own web grabber that can screen scrape the web to a database or Excel has never been easier. Web Scraper Lite delivers the data you need to go to market faster than ever.

web spider web crawler web extract crawlers email extractor web grabber website spider screen scraping spidering screen scraper 

email software

Email Spider by RebrandSoftware.com

This brand new software takes Email Spiders/Crawlers to a new level by finding emails based on your targeted search terms and harnessing the power of Google and Yahoo. All you do is enter a few "search strings" that are relevant to your target audience, and click the Start button. The email spider will then find "starting websites" using Google or Yahoo.

email email addresses spider crawler robot ha

Answered (Verified) Verified Answer

Top 100 Contributor
Male
1 Posts

Ive been using STS Web Crawler since you've mentioned it here. It's super useful.  Thanks for sharing!

All Replies

Top 100 Contributor
Male
1 Posts

Ive been using STS Web Crawler since you've mentioned it here. It's super useful.  Thanks for sharing!

Top 10 Contributor
Male
922 Posts

Thanks for the recommendations, all.

I will have to take a look.

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Page 1 of 1 (3 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2009, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems