Sorry, but there are no more tags available to filter with.
-
1.) Look into writing a CrawlAction with a CrawlActionType of 'PreRequest'. You can make whatever modifications to the WebClient you desire. 2.) The CredentialCache functionality is very, very new and was requested by another user - and he was happy with the results. So, I'm open to suggestions...
-
Right. The code is in the trunk and not part of a release... yet... http://arachnodenet.svn.sourceforge.net/viewvc/arachnodenet/trunk/SiteCrawler/Crawler.cs?revision=179&view=markup
-
I haven't explicitly tried downloading from an HTTPS site where a username/password combo was required.
-
Actually, I just added an overload to Crawler.cs so you can pass in a CredentialCache. Try that? Thanks! Mike