Hi all, I am using arachnode.net webcrawler and after crawling is complete when I checked WebPages table then for Source column , I found that the content of source column is empty. After casting that in byte (byte array) the length of array was found to be 0 only. Means no content of webpage is saved in database.
Why is this happening? Please help. I am using paid version of arahnode.net web cralwer.
I ran the following query as well to convert byte content to string, but that too showed empty string
TOP 1000 AbsoluteUri, CodePage, dbo.ConvertSource(Source, CodePage) as
The result of this query is as follows:
Please help me in resolving this issue.
Set ApplicationSettings.InsertWebPageSource = true;
For best service when you require assistance: