Sekhol Finder by Sekhol Technologies
A tool for automating deep searches on the Internet. Combines web crawler functionality with advanced keywords text search and logical analysis of a document layout. Starts with consulting main search engines and then proceeds downloading pages using the links in the meaningful part of the relevant documents. The visited pages with summaries and thumbnail images are available for instant offline preview saving a lot of time for a user
search crawler bot keywords automation marketing personal web search robotautomating deep searches internet
URL Spider Pro by Innerprise
URL Spider Pro is designed for creating a Google/AltaVista style topic specific search engine for your Web site. You simply tell it what type of information it should index and it will go through the Web collecting only documents containing that information. With URL Spider Pro, you can create a search engine for any topic, no matter how specific.
site search engine research portal spider crawl index database web web crawlersearch engine indexing site web
Fax Spider by Rebrand Software, LLC
Harvest fax numbers from the net using this Fax Spider, which finds fax numbers that are targeted by utilizing the Google and Yahoo search engines. Finds thousands of fax numbers an hour, which makes scanning for vulnerabilities easy!
email fax number spider crawler robot harvest web crawler web spider web robot
STS Web Crawler by SofTex Solutions
If you develop web pages for a living, this tool is for you! Trace links throughout your site. Browse and edit files on the fiy. And, if you're a ColdFusion developer the STS Web Crawler will make managing your pages a snap with lookups for cfincludes, cflocations, cfqueries, and even cfstoredprocs. The STS Web Crawler can even harvest all the unique items (links, images, cfincludes, etc.) for any branch of your site.
coldfusion cf cold fusion internet links images trace sts softex solutions
Inspyder OrFind by Inspyder Software Inc.
Inspyder OrFind is a powerful webserver cleanup and monitoring tool. If you''ve ever wanted to know which files on your webserver are actually used by your website, the answer is here. OrFind crawls your site looking for all included files (even those included through CSS), it then checks your FTP server or a local directory for orphans. OrFind can delete the orphans with the click of a button or export the results to a customizable HTML report.
orphan analaysis orphan page finder orphaned file finder server cleanup website cleanup remove unused files unused file
Web Scraper Lite by Velocityscape
Eliminate cut and paste! Web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, govt. databases, real estate listings. Our easiest product yet! Creating your own web grabber that can screen scrape the web to a database or Excel has never been easier. Web Scraper Lite delivers the data you need to go to market faster than ever.
web spider web crawler web extract crawlers email extractor web grabber website spider screen scraping spidering screen scraper
Email Spider by RebrandSoftware.com
This brand new software takes Email Spiders/Crawlers to a new level by finding emails based on your targeted search terms and harnessing the power of Google and Yahoo. All you do is enter a few "search strings" that are relevant to your target audience, and click the Start button. The email spider will then find "starting websites" using Google or Yahoo.
email email addresses spider crawler robot ha
Ive been using STS Web Crawler since you've mentioned it here. It's super useful. Thanks for sharing!
Thanks for the recommendations, all.
I will have to take a look.
An open source .NET web crawler written in C# using SQL 2008.
Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872
Twitter: http://twitter.com/arachnode_net
arachnode.net is provides custom crawling and contracting resources. Please ask.
http://bit.ly/TOFX4