Hi all, I am using arachnode.net webcrawler and after crawling is complete when I checked WebPages table then for Source column , I found that the content of source column is empty. After casting that in byte[] (byte array) the length of array was found to be 0 only. Means no content of webpage is saved in database.
Why is this happening? Please help. I am using paid version of arahnode.net web cralwer.
I ran the following query as well to convert byte[] content to string, but that too showed empty string
';SELECT
TOP 1000 AbsoluteUri, CodePage, dbo.ConvertSource(Source, CodePage) as
data
FROM [dbo].
[WebPages]'
The result of this query is as follows:
Please help me in resolving this issue.
Set ApplicationSettings.InsertWebPageSource = true;
For best service when you require assistance:
Skype: arachnodedotnet