Page 1 of 1

Job aggregator aborted.

Posted: Thu Dec 30, 2004 10:59 pm
by sainath
hi

when ever i run server jobs i will get warning message that job is aborted.actually what is it?how can i solve this problem.

sai

Posted: Fri Dec 31, 2004 12:09 am
by ray.wurlod
Welcome aboard! :D

The Aggregator stage, as you'll discover by searching this Forum, is notorious for not coping with large (or even medium) volumes of unsorted data.

Workarounds are:
  • pre-sort the data to be aggregated (for example using ORDER BY when selecting from a database) - but avoid the Sort stage for this task for it, too, has memory problems

    avoid the Aggregator: use an intermediate database stage instead (a UV stage will do); insert the raw rows and then select from the other side using regular SQL syntax (GROUP BY and aggregate functions)
It is possible to tune the memory demands for the Aggregator stage, but this is not really a topic for beginners. Try one of the above, more robust, techniques instead.