I have been running the crawl for a year now on a 4 sites.
Recently the crawls seems to be freezing in the middle of the crawl on all sites.This issue first started occurring on one of the sites and now all are "Infected".I have tried running the Crawler on the console application for testing, but the issue is not resolved.
I get no exceptions nor errors, The window just stops updating (no new lines of data appear) while the console window is still alive (I can sent "Enter" manually).
Thank you in advance,Runny
My instincts tell me you are being throttled.
Your version doesn't contain a lot of the auto-throttling functionality that is in the later versions. AN 2.6 will detect how fast the webservers want to serve you data and will slow itself so you don't get blocked, which sounds like what is happening with your crawls.
Another thing to look at is, how much data do you have in your DB's? Any chance you are overrunning what you machine(s) can handle?
Make sure you aren't running into any of the conditions here: http://arachnode.net/blogs/arachnode_net/archive/2010/08/27/memory-conditions-to-avoid.aspx
For best service when you require assistance:
OK. Starting now... :)