add_to_heap() - Unable to allocate memory

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
gsym
Charter Member
Charter Member
Posts: 118
Joined: Thu Feb 02, 2006 3:05 pm

add_to_heap() - Unable to allocate memory

Post by gsym »

Hi Gurus,
i have a 64 bit hashed file, created by using the code
RESIZE hashedfile_name 18 13671881 2 64BIT.
after loading 800000 records, the job is getting aborted with the warning "add_to_heap() - Unable to allocate memory" . i have sufficient space in the disk.

any help is appreciated.

Thank you
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Memory <> disk space. Memory = RAM. If you have Write Cache enabled, turn it off or try bumping the value for that in the Administrator.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Turn Write cache off. This hashed file (14GB if no overflow) will never fit even in the maximum possible write cache (999MB).

The message is simply alerting you to this fact.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
gsym
Charter Member
Charter Member
Posts: 118
Joined: Thu Feb 02, 2006 3:05 pm

Post by gsym »

Thanks Craig n Ray,

Okay i will Turn Write cache off.
Shall i put write cache size as 999MB?
Is there any other way to improve the performance of this job?

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Possibly. It rather depends on what the job does. But there's no flexibility with a hashed file of this size. You've already indicated in another post that you need every column and every row that you're loading into the hashed file - but you might like to verify this assertion.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply