arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL Server 2008/2012/2014/2016/CE An Open Source C# web crawler with Lucene.NET search using MongoDB/RavenDB/Hadoop

Completely Open Source @ GitHub

Does arachnode.net scale? | Download the latest release

web service integration

rated by 0 users
Answered (Verified) This post has 1 verified answer | 3 Replies | 2 Followers

Top 25 Contributor
23 Posts
victor posted on Sun, Jan 8 2017 12:24 PM

I'm an AN newbie, so here to ask for some basic directions.

I'd like to use AN to create a search feature in my existing main solution. I have a list of items with website as a property, so I want to search these items, based on keywords, that their websites contain.

So I want to have a kind of web worker, crawling websites from my database. And then I want to access search results from my webservice and match them to my items.

Could you suggest steps to implement this feature, are there any plugins maybe?

Thanks a lot for help!

Vic.

Answered (Verified) Verified Answer

Top 10 Contributor
1,905 Posts
Verified by victor

Vic:

This is an existing, stable and released feature of AN already.  Smile

https://workingcopy.arachnode.net/Web/Services/

Thanks!
Mike 

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

All Replies

Top 10 Contributor
1,905 Posts
Verified by victor

Vic:

This is an existing, stable and released feature of AN already.  Smile

https://workingcopy.arachnode.net/Web/Services/

Thanks!
Mike 

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Top 25 Contributor
23 Posts
victor replied on Mon, Jan 9 2017 10:48 AM

AwesomeSmile

Thank you very much for such a quick answer!

I'm trying to test services endpoints and having some troubles with Session.

I click 'invoke' button on webservice test page

And then get this:

System.NullReferenceException: Object reference not set to an instance of an object.

   at Arachnode.Web.Value.AbstractClasses.AWebService.get_ArachnodeDAO() in C:\arachnodedotnet\Web\Value\AbstractClasses\AWebService.cs:line 82

   at Arachnode.Web.Value.AbstractClasses.AWebService..ctor() in C:\arachnodedotnet\Web\Value\AbstractClasses\AWebService.cs:line 71

   at Arachnode.Web.Services.ServiceService..ctor()

Haven't changed anything in sources, so decided to ask, if there is anything to fix in sources or more likely in my environment?

Top 10 Contributor
1,905 Posts

Do you have the connection string set in the Web app.config?

Using a named instance, perhaps?

Mike

For best service when you require assistance:

  1. Check the DisallowedAbsoluteUris and Exceptions tables first.
  2. Cut and paste actual exceptions from the Exceptions table.
  3. Include screenshots.

Skype: arachnodedotnet

Page 1 of 1 (4 items) | RSS
An Open Source C# web crawler with Lucene.NET search using SQL 2008/2012/CE

copyright 2004-2017, arachnode.net LLC