I could not find much information on crawling frames using Arachnode. Could you please let me know if Arachnode supports frames and if so, how do I configure it to crawl frames?
I did a crawl on a site that had frames but did not get any urls that were referenced withing the frames.
What is the site you are trying to crawl?
EDIT: This is fixed.
For best service when you require assistance:
frames are usuallu ignored by crawlers. you can write your own plugin to extract the frame html/page and create a crwalrequest