Help Needed

vishalishere — Tue, 06 Oct 2009 22:37:34 GMT

Hi,

I would greatly appreciate any help, I am new to AN, i managed to get it up and running, It was actually not bad, just 4 easy steps and it's up and running, now here is what i am trying to achieve,

1) I have a list of web sites approximately 200 sites (these are job sites, job aggregators, companies having job posting pages etc)

2) I want to use AN to crawl each site and extract the content crawled and store it in db, because each job would have some title (hopefully) tag the result appropriately, for example a software engineer job with skillset as C#, ASP.net may be tagged as "Software Engineer", "ASP.net", "Developer", "C#", "May be job location"

3) Repeat this process every 2 days and update the database

4) while crawling if the job posts have email addresses, phone numbers, web addresses then store them separately but link them to crawled content

5) AN to run as a service

6) Afterwards I want to put a WebApp that shows the results on a web page based on user entered criteria ran over the crawled results,

I know this is quite a lot to ask, I am also trying to get it going myself but it would be much quicker if I can get a helping hand on this.

With Regards,

Vishal

vishalishere@msn.com

Search results matching tags 'robots.txt' and 'Globalization'

Help Needed