arachnode.net
An open source .NET web crawler written in C# using SQL 2005/2008
IT Professionals & Windows Deployment Professionals: SmartDeploy Enterprise is the first hardware-independent imaging toolset that uses boot time driver-injection, simplifying deployment and easing distribution by reducing total image count. [LINK]

Cannot insert duplicate key row in object 'dbo.Extensions' with unique index 'IX_Extensions'. Cannot insert the value NULL into column 'ExtensionID', table 'arachnode.net.dbo.Extensions_Discoveries'; column does not allow nulls. INSERT fails. The stateme

rated by 0 users
Answered (Verified) This post has 1 verified answer | 6 Replies | 2 Followers

Top 10 Contributor
219 Posts
megetron posted on 25 Aug 2009 6:01 PM

Just recieve this on the exception table. don't sure what this one means. I post 2 error exceptions here maybe you would know better. (I changes links so the post won't be appended)

Created ID AbsoluteUri1 AbsoluteUri2 HelpLink Message Source StackTrace
2009-08-26 03:52:20.123 1359 tim.co.il/movies/view.aspx?id=22361&Vote.152646=3 NULL NULL Cannot insert duplicate key row in object 'dbo.Extensions' with unique index 'IX_Extensions'.  Cannot insert the value NULL into column 'ExtensionID', table 'arachnode.net.dbo.Extensions_Discoveries'; column does not allow nulls. INSERT fails.  The statement has been terminated.  The statement has been terminated. .Net SqlClient Data Provider    at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)     at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)     at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()     at System.Data.SqlClient.SqlDataReader.get_MetaData()     at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)     at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)     at System.Data.SqlClient.SqlCommand.ExecuteScalar()     at Arachnode.DataSource.ArachnodeDataSetTableAdapters.QueriesTableAdapter.InsertWebPage(String WebPageAbsoluteUri, String ResponseHeaders, Byte[] Source, String FullTextIndexType, Nullable`1 CrawlDepth, Nullable`1 ClassifyAbsoluteUri, Nullable`1& WebPageID)     at Arachnode.DataAccess.ArachnodeDAO.InsertWebPage(String webPageAbsoluteUri, String responseHeaders, Byte[] source, String fullTextIndexType, Int32 crawlDepth)
2009-08-26 03:52:19.890 1358 tim.co.il/movies/actors/view.aspx?id=18311 NULL NULL Cannot insert duplicate key row in object 'dbo.Extensions' with unique index 'IX_Extensions'.  Cannot insert the value NULL into column 'ExtensionID', table 'arachnode.net.dbo.Extensions_Discoveries'; column does not allow nulls. INSERT fails.  The statement has been terminated.  The statement has been terminated. .Net SqlClient Data Provider    at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)     at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)     at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)     at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()     at System.Data.SqlClient.SqlDataReader.get_MetaData()     at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)     at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)     at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)     at System.Data.SqlClient.SqlCommand.ExecuteScalar()     at Arachnode.DataSource.ArachnodeDataSetTableAdapters.QueriesTableAdapter.InsertWebPage(String WebPageAbsoluteUri, String ResponseHeaders, Byte[] Source, String FullTextIndexType, Nullable`1 CrawlDepth, Nullable`1 ClassifyAbsoluteUri, Nullable`1& WebPageID)     at Arachnode.DataAccess.ArachnodeDAO.InsertWebPage(String webPageAbsoluteUri, String responseHeaders, Byte[] source, String fullTextIndexType, Int32 crawlDepth)

Answered (Verified) Verified Answer

Top 10 Contributor
1,244 Posts

This error can be safely ignored.

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

All Replies

Top 10 Contributor
1,244 Posts

Where is the rest of the AbsoluteUri: tim.co.il/movies/view.aspx?id=22361 ?

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
219 Posts

replace "tim" with "sratim" please.

Top 10 Contributor
1,244 Posts

I mean - where is 'http'...???

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
219 Posts

I remove the http when edit the post. remmember that when I post here links with http the post is bannes and appended....so I edit.

Top 10 Contributor
1,244 Posts

What settings were you running with?

How long had the crawl been running for?

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
1,244 Posts

This error can be safely ignored.

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Page 1 of 1 (7 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2004-2010, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems