I've used your console app as an example for another console app I'm writing, and copied out the general structure (in regards to where you instantiate stopwatch, crawler engine, inject crawlrequests, etc.). AFAIK I've kept the structure pretty much similar.
The error I'm encountering at the moment is during some crawls, the green "Elapsed. Press any key to terminate arachnode.net" message appears and I assume the crawl is complete. However a few seconds later, I get output appearing on the screen as if the database is just being written to.
Further examination of the dbo.Hyperlinks table shows that it is empty when the message appears, however gets populated when the further output appears. Essentially, the termination message is getting displayed before the program has finished executing.
Do you have any idea what may be causing this? FYI I've upgraded the solution to VS2010, and in my console application I'm using the Entity Framework to access some arachnode tables.
For how long after do you see activity in the HL table?
Are you using the .zip code or the latest from SVN?
For best service when you require assistance:
It seems to be outputting more discovery results - it'll run for another minute or so.
It never gave any problems when I was running it in VS2008. I got this copy from SVN in December.
Try updating your source from SVN.
No piece of software is without bugs and I do fix and check in.
Thought I'd upload a screenshot to help you out