arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop
Search the Live Index Does arachnode.net scale? | Download the latest release

Exception in Console Project

rated by 0 users
Answered (Verified) This post has 1 verified answer | 1 Reply | 2 Followers

Top 100 Contributor
5 Posts
Syed Rizwan ul haq posted on Thu, Jul 16 2015 1:08 PM

I am trying to run console project in Demo application, Following exception raised.

Exception logged in exception table

The 'LastModified' HttpResponse Header indicated that the Data was not stale, but the Data (Source) could not be found in the Images database table or at ApplicationSettings.DownloadedImagesDirectory.

 

Any help

 

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts
Verified by arachnode.net

This means you could have used a cached version instead of hitting the server, but AN couldn't find the Source in the DB or on Disk.

ApplicationSettings.InsertWebPageSource = true; (or)

ApplicationSettings.SaveDiscoveredWebPagesToDisk = true;

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (2 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC