arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

Cannot insert duplicate key row in object 'dbo.Extensions' with unique index 'IX_Extensions'. Cannot insert the value NULL into column 'ExtensionID', table 'arachnode.net.dbo.Extensions_Discoveries'; column does not allow nulls. INSERT fails. The stateme

rated by 0 users
Answered (Verified) This post has 1 verified answer | 6 Replies | 2 Followers

Top 10 Contributor
229 Posts
megetron posted on Tue, Aug 25 2009 6:01 PM

Just recieve this on the exception table. don't sure what this one means. I post 2 error exceptions here maybe you would know better. (I changes links so the post won't be appended)

Created ID AbsoluteUri1 AbsoluteUri2 HelpLink Message Source StackTrace
2009-08-26 03:52:20.123 1359 tim.co.il/movies/view.aspx?id=22361&Vote.152646=3 NULL NULL Cannot insert duplicate key row in object 'dbo.Extensions' with unique index 'IX_Extensions'.  Cannot insert the value NULL into column 'ExtensionID', table 'arachnode.net.dbo.Extensions_Discoveries'; column does not allow nulls. INSERT fails.  The statement has been terminated.  The statement has been terminated. .Net SqlClient Data Provider    at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)     at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)     at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()     at System.Data.SqlClient.SqlDataReader.get_MetaData()     at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)     at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)     at System.Data.SqlClient.SqlCommand.ExecuteScalar()     at Arachnode.DataSource.ArachnodeDataSetTableAdapters.QueriesTableAdapter.InsertWebPage(String WebPageAbsoluteUri, String ResponseHeaders, Byte[] Source, String FullTextIndexType, Nullable`1 CrawlDepth, Nullable`1 ClassifyAbsoluteUri, Nullable`1& WebPageID)     at Arachnode.DataAccess.ArachnodeDAO.InsertWebPage(String webPageAbsoluteUri, String responseHeaders, Byte[] source, String fullTextIndexType, Int32 crawlDepth)
2009-08-26 03:52:19.890 1358 tim.co.il/movies/actors/view.aspx?id=18311 NULL NULL Cannot insert duplicate key row in object 'dbo.Extensions' with unique index 'IX_Extensions'.  Cannot insert the value NULL into column 'ExtensionID', table 'arachnode.net.dbo.Extensions_Discoveries'; column does not allow nulls. INSERT fails.  The statement has been terminated.  The statement has been terminated. .Net SqlClient Data Provider    at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)     at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)     at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()     at System.Data.SqlClient.SqlDataReader.get_MetaData()     at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)     at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)     at System.Data.SqlClient.SqlCommand.ExecuteScalar()     at Arachnode.DataSource.ArachnodeDataSetTableAdapters.QueriesTableAdapter.InsertWebPage(String WebPageAbsoluteUri, String ResponseHeaders, Byte[] Source, String FullTextIndexType, Nullable`1 CrawlDepth, Nullable`1 ClassifyAbsoluteUri, Nullable`1& WebPageID)     at Arachnode.DataAccess.ArachnodeDAO.InsertWebPage(String webPageAbsoluteUri, String responseHeaders, Byte[] source, String fullTextIndexType, Int32 crawlDepth)

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts
Verified by arachnode.net

This error can be safely ignored.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

All Replies

Top 10 Contributor
1,905 Posts

Where is the rest of the AbsoluteUri: tim.co.il/movies/view.aspx?id=22361 ?

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

replace "tim" with "sratim" please.

Top 10 Contributor
1,905 Posts

I mean - where is 'http'...???

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
229 Posts

I remove the http when edit the post. remmember that when I post here links with http the post is bannes and appended....so I edit.

Top 10 Contributor
1,905 Posts

What settings were you running with?

How long had the crawl been running for?

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 10 Contributor
1,905 Posts
Verified by arachnode.net

This error can be safely ignored.

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (7 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC