arachnode.net
An open source .NET web crawler written in C# using SQL 2005/2008
Forums » arachnode.net » Announcements » http://arachnode.net 1.2 release +lucene.net
IT Professionals & Windows Deployment Professionals: SmartDeploy Enterprise is the first hardware-independent imaging toolset that uses boot time driver-injection, simplifying deployment and easing distribution by reducing total image count. [LINK]

http://arachnode.net 1.2 release +lucene.net

rated by 0 users
This post has 5 Replies | 1 Follower

Top 10 Contributor
Posts 1,244
Reply
arachnode.net Yes [Y] Posted: 3 Jun 2009 6:10 PM

Hi all!

I wanted to let everyone know that we have merged branch-1.2 into the trunk.

This means we are very, very close to an official release!!!

Thank you to everyone who has helped with feature requests, suggestions, bug reports and documentation!!!

  • The majority of Version 1.2 was dedicated to installation and configuration, and some light refactoring of Actions and Rules. 
  • Free-crawling is now prioritized by pre-configured Domain priorities, and search results now gain the benefit of Popularity/Priority, thereby further enhancing search result accuracy.
  • Finally, we added a WebService for searching and clustering functionality for the search page.

Thanks again, and please get latest from the trunk, test and let's get 1.2 out the door!!!  :)

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
Male
Posts 101
Reply
Kevin replied on 3 Jun 2009 6:23 PM

Great work!!!

Top 25 Contributor
Male
Posts 11
Reply
Jay Stevens replied on 4 Jun 2009 6:00 AM

Any DB structural changes or just code?

Top 10 Contributor
Posts 1,244
Reply
arachnode.net replied on 4 Jun 2009 8:33 AM

Nothing too crazy - but I did segment the configuration tables into their own schema.

I did add the Priorities table.

When we give the AOK I will make a master DB update.

Mike

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
Posts 1,244
Reply
arachnode.net replied on 13 Jun 2009 7:47 AM

Just fixed a few bugs related to Discovery restrictions and clustering of the results for Search.aspx are fixed and committed.

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Top 10 Contributor
Posts 1,244
Reply
arachnode.net replied on 3 Jul 2009 10:14 AM

Just updated the site to reflect SQL2008 instead of SQL2005.

For best service when you require assistance:  Big Smile

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

An open source .NET web crawler written in C# using SQL 2005/2008.

Twitter: http://twitter.com/arachnode_net

arachnode.net provides custom crawling and contracting resources.  Please ask.

C# crawler, C# web crawler, C# site crawler

Page 1 of 1 (6 items) | RSS
An open source .NET web crawler written in C# using SQL 2005/2008

copyright 2004-2010, arachnode.net LLC

Powered by Community Server (Non-Commercial Edition), by Telligent Systems