arachnode.net v2.0
An open source .NET web crawler written in C# using SQL 2005/2008

http://arachnode.net 1.2 release +lucene.net

rated by 0 users
This post has 5 Replies | 1 Follower

Top 10 Contributor
Male
Posts 927
arachnode.net Yes [Y] Posted: 06-03-2009 6:10 PM

Hi all!

I wanted to let everyone know that we have merged branch-1.2 into the trunk.

This means we are very, very close to an official release!!!

Thank you to everyone who has helped with feature requests, suggestions, bug reports and documentation!!!

  • The majority of Version 1.2 was dedicated to installation and configuration, and some light refactoring of Actions and Rules. 
  • Free-crawling is now prioritized by pre-configured Domain priorities, and search results now gain the benefit of Popularity/Priority, thereby further enhancing search result accuracy.
  • Finally, we added a WebService for searching and clustering functionality for the search page.

Thanks again, and please get latest from the trunk, test and let's get 1.2 out the door!!!  :)

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Top 10 Contributor
Male
Posts 101

Great work!!!

Top 25 Contributor
Male
Posts 11

Any DB structural changes or just code?

Top 10 Contributor
Male
Posts 927

Nothing too crazy - but I did segment the configuration tables into their own schema.

I did add the Priorities table.

When we give the AOK I will make a master DB update.

Mike

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Top 10 Contributor
Male
Posts 927

Just fixed a few bugs related to Discovery restrictions and clustering of the results for Search.aspx are fixed and committed.

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Top 10 Contributor
Male
Posts 927

Just updated the site to reflect SQL2008 instead of SQL2005.

An open source .NET web crawler written in C# using SQL 2008.

Join the arachnode.net group on Facebook: http://www.facebook.com/groups.php?ref=sb#/group.php?gid=166721755872

Twitter: http://twitter.com/arachnode_net

arachnode.net is provides custom crawling and contracting resources.  Please ask.

http://bit.ly/TOFX4

Page 1 of 1 (6 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2009, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems