arachnode.net v2.0
An open source .NET web crawler written in C# using SQL 2005/2008

Database Tables tutorial

rated by 0 users
Answered (Verified) This post has 1 verified answer | 3 Replies | 2 Followers

Top 10 Contributor
155 Posts
megetron posted on 05-22-2009 7:06 AM

Hello,

Is there any good tutorial explains the database structure? the tables and columns?

Thanks.

Answered (Verified) Verified Answer

Top 10 Contributor
Male
927 Posts

Those tables you see are reporting tables and are used to hold the results of link analysis.

Look at the stored procedures - there is one for each one of those tables.

(I know - there are a LOT of tables - we are working on selecting a database documentation solution to add to the help... thank you for your patience...)

As a starter the schemas in the database help you to determine which is core crawling, reporting and configuration.

dbo = core crawling

rpt = reporting

cfg = configuration (coming in Version 1.2)

-Mike

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

All Replies

Top 10 Contributor
Male
927 Posts

There isn't at this time.

Everything is explicitly named though - what do you have questions with?

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Top 10 Contributor
155 Posts

I am just not sure about the so many tables. there is more then 10 tables starting with HyperLinks, Images, EmailAdresses

and I dont see any data within it, so I am all confused.

 

Top 10 Contributor
Male
927 Posts

Those tables you see are reporting tables and are used to hold the results of link analysis.

Look at the stored procedures - there is one for each one of those tables.

(I know - there are a LOT of tables - we are working on selecting a database documentation solution to add to the help... thank you for your patience...)

As a starter the schemas in the database help you to determine which is core crawling, reporting and configuration.

dbo = core crawling

rpt = reporting

cfg = configuration (coming in Version 1.2)

-Mike

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Page 1 of 1 (4 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2009, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems