arachnode.net
An Open Source C# web crawler with Lucene.NET search using SQL 2005/2008/CE
Sign in
|
Join
|
Help
Home
Features
Compare
Download
License
Live Demonstration
Support
Contact
API Documentation
Blogs
Creating Plugins
Forums
Frequently Asked Questions
Installation Instructions
Working Copy
All Tags
»
ContentTypes
(
RSS
)
Does arachnode.net scale?
| VS2008/2010/2012 & SQL2008/2012 |
Download the latest release
Browse Forum Posts by Tags
Showing related tags and posts for the
General Questions
forum. See
all tags in the site
AllowedDataTypes
ATOM
Crawling RSS Feeds
RSS
Re: Setting arachnode up for rss-collection
Just for others that read this post... when troubleshooting AN, start by looking in the database tables 'Exceptions' and 'DisallowedAbsoluteUris'. For your question: Take a look at cfg.AllowedDataTypes. This table controls what you are allowed to crawl. First step it to make sure that...
Posted to
General Questions
(Forum)
by
arachnode.net
on Thu, Aug 20 2009
Page 1 of 1 (1 items)
An Open Source C# web crawler with Lucene.NET search using SQL 2005/2008/CE
copyright 2004-2013, arachnode.net LLC