arachnode.net
An open source .NET web crawler written in C# using SQL 2005/2008
Forums » arachnode.net » General Questions » Database Tables tutorial
IT Professionals & Windows Deployment Professionals: SmartDeploy Enterprise is the first hardware-independent imaging toolset that uses boot time driver-injection, simplifying deployment and easing distribution by reducing total image count. [LINK]

Database Tables tutorial

rated by 0 users
Answered (Verified) This post has 1 verified answer | 3 Replies | 2 Followers

Top 10 Contributor
219 Posts
megetron posted on 22 May 2009 7:06 AM

Hello,

Is there any good tutorial explains the database structure? the tables and columns?

Thanks.

Answered (Verified) Verified Answer

Top 10 Contributor
1,244 Posts
Reply
Answered (Verified) arachnode.net replied on 26 May 2009 8:39 PM
Verified by megetron

Those tables you see are reporting tables and are used to hold the results of link analysis.

Look at the stored procedures - there is one for each one of those tables.

(I know - there are a LOT of tables - we are working on selecting a database documentation solution to add to the help... thank you for your patience...)

As a starter the schemas in the database help you to determine which is core crawling, reporting and configuration.

dbo = core crawling

rpt = reporting

cfg = configuration (coming in Version 1.2)

-Mike

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

All Replies

Top 10 Contributor
1,244 Posts
Reply
arachnode.net replied on 24 May 2009 1:17 PM

There isn't at this time.

Everything is explicitly named though - what do you have questions with?

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
219 Posts
Reply
megetron replied on 25 May 2009 7:59 AM

I am just not sure about the so many tables. there is more then 10 tables starting with HyperLinks, Images, EmailAdresses

and I dont see any data within it, so I am all confused.

 

Top 10 Contributor
1,244 Posts
Reply
Answered (Verified) arachnode.net replied on 26 May 2009 8:39 PM
Verified by megetron

Those tables you see are reporting tables and are used to hold the results of link analysis.

Look at the stored procedures - there is one for each one of those tables.

(I know - there are a LOT of tables - we are working on selecting a database documentation solution to add to the help... thank you for your patience...)

As a starter the schemas in the database help you to determine which is core crawling, reporting and configuration.

dbo = core crawling

rpt = reporting

cfg = configuration (coming in Version 1.2)

-Mike

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Page 1 of 1 (4 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2004-2010, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems