arachnode.net
An open source .NET web crawler written in C# using SQL 2005/2008
IT Professionals & Windows Deployment Professionals: SmartDeploy Enterprise is the first hardware-independent imaging toolset that uses boot time driver-injection, simplifying deployment and easing distribution by reducing total image count. [LINK]

ArachnodeDAO

rated by 0 users
Not Answered This post has 0 verified answers | 2 Replies | 1 Follower

Top 10 Contributor
26 Posts
pp.ps posted on 8 Mar 2010 7:48 AM

Hello - did u ever think about refactor ArachnodeDAO to interface without dependency on DataTableAdapters. Your implementation with table adapter in that case will be one of option.

Below u'll find my propose to interface:

 

IArachnodeDAO {
void DeleteCrawlRequest(string absoluteUri1, string absoluteUri2)
void DeleteDiscoveries()
... 
List<DataType> GetAllowedDataTypes();
List<ACrawlAction> GetCrawlActions();
...

}

 

After that refactoring arachnode.net would be elastic application without dependency on mssql database. 

best regards

 

All Replies

Top 10 Contributor
1,250 Posts

That would be a nice option.

There are a few things to consider when performing such a refactor.

1.) Data validation is performed by the DataTableAdapters.

2.) There is logic in the MS-SQL database that would have to be replicated to, say, MySQL.

3.) There is functionality that is present in MS-SQL that is only in MS-SQL, like the reporting SP's.

Easy enough to pull an interface out of the ArachnodeDAO, but a lot more work to make it truly portable to another RDBMS.

Thanks!
Mike

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
26 Posts

Hello, 
1/ Data validation is a problem of developer who impelment your interface,
2/  Yea - this is a problem of developer too
3/  I dont know how it works, but this i a problem of developer too

In summary, you give an elastic interface, with pre-built implementation of mssql. Developer who want to implement other RDMS take care about implement all methods which he needs to.

Page 1 of 1 (3 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2004-2010, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems