Is there any way to not consider subdomain while crawling?
Use UriClassificationType.Host as the RestrictCrawlTo and RestrictDiscoveriesTo value.
For best service when you require assistance:
Do you mean if a link is found on msn.com that points to cars.msn.com, don't allow the Crawler to crawl cars.msn.com?
I need the same thing to exclude subdomains like msn.com, cars.msn.com
This kind of sub-domain and also the domains like yahoo.com, facebook.com twitter.com too.