Heap allocation failed

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Sakthi_Sst
Participant
Posts: 36
Joined: Wed Aug 09, 2006 12:18 am
Location: Chennai

Heap allocation failed

Post by Sakthi_Sst »

Hi All,

My issue would be "Heap allocation failed" when running around 505 million data.
1.I have a 8 node system datastage server
2.Source is Teradata in Datastage 7.5.1PX.
3.Reading from a Teradata Enterprise stage.
4.It reads upto 260 million records and then job aborts with an error "Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed." iam using SessionsPerPlayer=2,RequestedSessions=8 in the DB options in teradata stage.
The data is not passing the read stage.

My Question,

1.what is the maximum number of SessionsPerPlayer and RequestedSessions for 1 node that can be specified?
2.what is the maximum number of SessionsPerPlayer and RequestedSessions i need to specify in my case?
2.Any workarounds for this error?
3.Any websites where i can get more information about Sessions per players.


Thanks and Regards,
Sakthivel T
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

try some search, many people got this error viewtopic.php?t=104344&postdays=0&posto ... on&start=0

RequestedSessions =number of nodes * SessionsPerPlayer[/url][/code]
Sakthi_Sst
Participant
Posts: 36
Joined: Wed Aug 09, 2006 12:18 am
Location: Chennai

Post by Sakthi_Sst »

Hi,

I got the calculation but im not sure how many sessions per player i can specify for a node.

RequestedSessions =number of nodes * SessionsPerPlayer


RequestedSessions =1 * SessionsPerPlayer(?) //for 1 node

Thanks,
Sakthi...
Sakthi
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

it will depend on the type of stages you have in your job.
if you have many Teradata enterprise stages, then you should consider about the number of FAST LOAD/FAST export you can run on your teradat server....
eg. if you have 4 TEE stages and your condiguration file has 8 nodes with 2 sessionsperplayer, then it will actually invoke 64 FAST load/FAST EXPORT sessions on teradata..
Post Reply