Is there a location to manipulate the URI coming in before checking if it is in the cache.
For me... I do not care that the page is five minutes older... I can get the same data by using simply
So instead of processing http://someuri/date=today or any other variation, I would like to trim the URI before checking it is in the cache / DB
Let me know if this is possible
Look at the AbsoluteUri.cs CrawlRule. You can filter on QueryStrings.
For best service when you require assistance: