-
Let's go with what I communicated over IM. There are several ways to achieve what (I think and hope) I understand your needs to be. The switches and modifications from the post were to support a batch-style analysis - but we actually need to implement a continuous crawling mechanism, which is what...