problem with Aggregator stage.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
zulfi123786
Premium Member
Premium Member
Posts: 730
Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore

problem with Aggregator stage.

Post by zulfi123786 »

"Aggregator_91,0: The current soft limit on the data segment (heap) size (2147483645) is less than the hard limit (2147483647), consider increasing the heap size limit"
This is the error i am getting.... Please advice how to overcome this.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Is this a warning message or an error message causing the job to abort? One option you have is to sort your incoming data according to your aggregation group(s).
zulfi123786
Premium Member
Premium Member
Posts: 730
Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore

Post by zulfi123786 »

this is an error message which is causing the job to abort
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

In that case your memory requirements for this stage are higher than what the machine can give you. Since you cannot increase your hard data segment size you will need to reduce your storage requirements, which can be done in this case by sorting your data before the aggregator stage.
Post Reply