Hello!
I've been able to get Arachnode.net to work despite being overwhelmed by the project and the console application works, the search.aspx for the Webproject works and I can goto the downloaded files/images/html directory and look at the expected output but I have two big questions.
Environment: Windows 7 / VS 2010 / SQL 2008 R2 / IIS
Question 1: When I goto the Administration page and click on one of the tables (http://localhost:15053/AllowedDataTypes/List.aspx) , I get the following error:
A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server)
My connection strings.config is
<?xml version="1.0" encoding="utf-8" ?>
<connectionStrings>
<add name="ArachnodeConnectionString" connectionString="Data Source=WIN7PVM\WIN7VM;Initial Catalog=arachnode.net;Integrated Security=True;Connection Timeout=3600;" providerName="System.Data.SqlClient" />
</connectionStrings>
Great! Glad you got almost all of it working.
1.) You probably need to update the connection string in web.config in the Administration project.
<add name="arachnode_netConnectionString" connectionString="Data Source=.;Initial Catalog=arachnode.net;Integrated Security=True" providerName="System.Data.SqlClient"/>
2.) Yes, AN crawls https by default.
Mike
For best service when you require assistance:
Skype: arachnodedotnet
1. Awesome. Now the Administration part talks fine to MS SQL Server.
2. HTTPS: Would you please point me towards the right direction? I looked it up and found something about Credential.Cache. Does this functionality require a license? I am planning to get a developer license at the very least [this is a proof of concept project running inside a Windows 7 VM :) - Linux shop and all].
Thank you for your reply and thanks again in advance.
Wonderful!
http://msdn.microsoft.com/en-us/library/system.net.credentialcache(v=VS.90).aspx
http://arachnode.net/search/SearchResults.aspx?q=credentialcache
The CredentialCache is added in the Crawler constructor.
public Crawler(CrawlMode crawlMode, CredentialCache credentialCache, bool enableRenderers) : this(crawlMode, enableRenderers)
{
CredentialCache = credentialCache;
}
I have a new version that is in beta testing that will compile under Mono, but uses the AN DB for storage. The next steps after that will be to wire in non-MS storage. All operations are abstracted out so that the crawler is entirely general and you can customize EVERYTHING about it. You can customize just about everything in AN now, but this version makes it even more flexible.
Ah Crawler.cs was one of the things I checked and I rubbed my eyes before realizing that this requires a license :). I'll bug you if I need more help after getting the licensed version. Cheers.
The crawler works just like the regular version, but is limited to 5 minutes of crawling time.
The CredentialCache should work.
Except Crawler.cs is in Klingon :). I just bought a developer license and once I hear from you, I can go about with the CredentialCache part in Crawler.cs.
Thanks again.
Are you out of Seattle? If so, check your mail.
Bellevue.
I did get a confirmation from Google checkout and Google Order page tells me my order is complete. The status says:
arachnode.net, llc will send an email to [email protected] with instructions for accessing your purchase
OK, I did but you didn't respond. I will add you to the Licensed group. One moment.
I think I checked the "hide my email address" so all email gets forwarded to me by Google and their service must be out to lunch :\. I can private message you my email address should you wish.
I will check the DB and send you another mail.
I downloaded the Licensed copy. Thankfully I have practice from yesterday . Thank you.
Don't forget to get the latest from SVN, OK? This is what you should be using for real development. It is what I work from for my own projects.