Heap Allocation Problem

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rsripathy
Participant
Posts: 21
Joined: Wed Sep 19, 2007 8:46 am

Heap Allocation Problem

Post by rsripathy »

log errors:
main_program: The current soft limit on the data segment (heap) size (805306368) is less than the hard limit (2147483647), consider increasing the heap size limit

main_program: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
aakashahuja
Premium Member
Premium Member
Posts: 210
Joined: Wed Feb 16, 2005 7:17 am

Post by aakashahuja »

try changing ulimit for the user to unlimited.
L'arrêt essayant d'être parfait… évoluons.
rsripathy
Participant
Posts: 21
Joined: Wed Sep 19, 2007 8:46 am

Post by rsripathy »

How to change ulimit?
DSRajesh
Premium Member
Premium Member
Posts: 297
Joined: Mon Feb 05, 2007 10:37 pm

Post by DSRajesh »

Is this problem has resolved?
RD
bart12872
Participant
Posts: 82
Joined: Fri Jan 19, 2007 5:38 pm

Post by bart12872 »

your job is consuming too memory (RAM).
Optimize it.
sreddy
Participant
Posts: 144
Joined: Sun Oct 21, 2007 9:13 am

Re: Heap Allocation Problem

Post by sreddy »

rsripathy

You can increase through Datastage Client (Adminstrator).

rsripathy wrote:log errors:
main_program: The current soft limit on the data segment (heap) size (805306368) is less than the hard limit (2147483647), consider increasing the heap size limit

main_program: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
SReddy
dwpractices@gmail.com
Analyzing Performance
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Yeah?!! :shock:

Please elaborate on how you can change an operating system setting through the DataStage Administrator client. Particularly something like ulimit, which requires superuser privileges to increase.
Last edited by ray.wurlod on Mon Jun 23, 2008 6:02 am, edited 1 time in total.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
DSRajesh
Premium Member
Premium Member
Posts: 297
Joined: Mon Feb 05, 2007 10:37 pm

Post by DSRajesh »

Hi reddy,

How can you change the ulimit value through administrator which is not possible using client?

can you pls explain me how can you do the same?

Regards,
RD
joffijoy
Participant
Posts: 22
Joined: Mon Jun 11, 2007 8:51 am

Re: Heap Allocation Problem

Post by joffijoy »

rsripathy wrote:log errors:
main_program: The current soft limit on the data segment (heap) size (805306368) is less than the hard limit (2147483647), consider increasing the heap size limit

main_program: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
Check the ulimit first

From unix Prompt type in > ulimit -aH ( for hard allocation limits) and > ulimit -aS (for soft allocation)

1)If they are not set to "unlimited" , ask your UNIX admin to do that.

2) Also frequest him to have sufficient temporary space( Scratch) added.

3) If you are using DB2 API stage there is a memory leak issue and you need to contact support to give you a patch.

I have seen similar issue in ODBC stage as well, but I am not sure of a patch available for it.


Thaks,
Joffi Joy.
Post Reply