Sequence getting aborted due to Heap allocation failed.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sreeramkumart
Participant
Posts: 9
Joined: Tue Nov 27, 2007 10:59 pm

Sequence getting aborted due to Heap allocation failed.

Post by sreeramkumart »

I am trying to run a extraction sequence and this seqeunce is getting aborted due to the below error in one of the job.

The current soft limit on the data segment (heap) size (2147483645) is less than the hard limit (2147483647), consider increasing the heap size limit.

Details of the aborting job:
This job is used to extract data from a SAP table using a BAPI interface.

Please let me know if any one has any pointers to this issue.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

You are doing more than simple reading & writing - is it possible that you have a sort stage in there somewhere, perhaps an implicit sort? Are you repartitioning during the course of your job?
The solution to your problem is to redesign your job to make more efficient use of the resources you have available.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Searching the forum for "heap allocation failed" (exact match) could prove illuminating.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Ray - Genius, pure Genius :roll:
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Yah, it's not like we've never talked about that error before.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply