Showing related tags and posts across the entire site.
-
Simon - See Program.cs... (in the 'crawl test code' region...) _crawler.Crawl(new CrawlRequest(new Discovery("http://fark.com"), int.MaxValue, UriClassificationType.None, UriClassificationType.None, 1)); The warning you see are debug artifacts that I have left behind. As long as the...
-
A front end would be nice - someday perhaps... (there is a partial one in the works that I know of - perhaps I should check on the status...) Check out Program.cs - this has a good example of how to use RestrictCrawlTo and RestrictDiscoveriesTo... Guess arachnode.net will have to live as a class library...