arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

There is already an open DataReader associated with this Command which must be closed first.

rated by 0 users
Answered (Verified) This post has 1 verified answer | 14 Replies | 2 Followers

Top 10 Contributor
229 Posts
megetron posted on Sat, May 1 2010 10:23 AM

Created ID AbsoluteUri1 AbsoluteUri2 HelpLink Message Source StackTrace
2010-05-01 19:04:07.123 171258 http://lyricsoncall.com/artist/emaar-lyrics.html NULL NULL There is already an open DataReader associated with this Command which must be closed first. System.Data    at System.Data.SqlClient.SqlInternalConnectionTds.ValidateConnectionForExecute(SqlCommand command)     at System.Data.SqlClient.SqlConnection.ValidateConnectionForExecute(String method, SqlCommand command)     at System.Data.SqlClient.SqlCommand.ValidateCommand(String method, Boolean async)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)     at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)     at System.Data.SqlClient.SqlCommand.ExecuteDbDataReader(CommandBehavior behavior)     at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)     at System.Data.Common.DbDataAdapter.FillInternal(DataSet dataset, DataTable[] datatables, Int32 startRecord, Int32 maxRecords, String srcTable, IDbCommand command, CommandBehavior behavior)     at System.Data.Common.DbDataAdapter.Fill(DataTable[] dataTables, Int32 startRecord, Int32 maxRecords, IDbCommand command, CommandBehavior behavior)     at System.Data.Common.DbDataAdapter.Fill(DataTable dataTable)     at Arachnode.DataSource.ArachnodeDataSetTableAdapters.DiscoveriesTableAdapter.Fill(DiscoveriesDataTable dataTable, String AbsoluteUri, Nullable`1 NumberOfDiscoveriesToReturn)     at Arachnode.DataAccess.ArachnodeDAO.GetDiscovery(String absoluteUri)

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts

OK.  That is what I suspected.  Old version.  There is locking in place which should fix this in 2.0.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

All Replies

Top 10 Contributor
1,905 Posts

No clue.  Did you modify the core?

Looks related to this one from the time: http://arachnode.net/forums/t/1174.aspx

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

No, I did not. I didn't look at all on version 1.3, after we made the performance upgrades, so now one of my tasls is to verify that all changes of 1.2 are ok, and nothing messed up.

I think that what I did is probably illegal. I used 200 threads, and AN couldn't handle it. after lower the crawl threads errors decreased.

are you sure you manage the threads correctly? seems like ehrn increasinf number of threads AN throws exception that we cannot understand.

any way, just a guess.

 

Top 10 Contributor
1,905 Posts

Hmm... good test.  Are you using the latest and greatest from SVN?  Which version are you using?  There were some error similar to this in 1.3, and one in 1.4 but I cleaned them up.  Let me know and I can fix.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

I will install the new version, and test it again. let you know, when it done.

Top 10 Contributor
1,905 Posts

OK.  That is what I suspected.  Old version.  There is locking in place which should fix this in 2.0.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

I am getting this

2.06.2010 - the AN SVN repository will return in one week.

where trying to download code from repository here:
https://arachnodenet.svn.sourceforge.net/svnroot/arachnodenet

any suggestions?
Top 10 Contributor
1,905 Posts

Check the Licensed download for the SVN information: http://arachnode.net/media/p/11157.aspx

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

Thanks, when I try to run the new version, I got notified a database was not found and there is a window to select the database.

Problem is that I cannot find the SQL server instance. my sql instance is MSSQLSERVER which not listed....

Top 10 Contributor
1,905 Posts

Odd???  AN wouldn't have anything to do with this though...

Is your SQL server started?  (sanity check...)

Mike

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

Defiently odd! and defiently this is no AN issue. Yes. SQL server started.

Maybe it will be a good time to check VS2010.

 

Top 10 Contributor
1,905 Posts

Could try that.  I use VS 2010 casually for research projects and it has a few quirks of its own.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
1,905 Posts

Try using the 'Microsoft SQL Server (SqlClient)' Provider.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

I tried every possible combination. after that tried to install VS2010 which didn't solve the issue.

Next victim must be the SQLSERVER which I don't want to uninstall...

There must be other solutions....I will look for it.

Top 10 Contributor
229 Posts

The problem is that the machine name is not localhost/MSSQLSERVER, buy only LOCALHOST..

at least I have VS2010 now, and so I can debug AN with the bew working env.

 

 

Page 1 of 1 (15 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC