Heap allocation failed.

laxmi_etl · Post by **laxmi_etl** » Fri Oct 13, 2006 2:44 pm

Any thoughts on below error??

APT_CombinedOperatorController,0: Current heap size: 1,595,049,352 bytes in 66,276,970 blocks
BC_Enterprise_6,0: Failure during execution of operator logic.
ODBC_Enterprise_6,0: Input 0 consumed 1616342 records.
APT_CombinedOperatorController,0: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
node_node1: Player 2 terminated unexpectedly.
PT_CombinedOperatorController,1: Current heap size: 1,595,049,328 bytes in 66,276,969 blocks
ODBC_Enterprise_6,1: Failure during execution of operator logic.
APT_CombinedOperatorController,1: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
ode_node2: Player 1 terminated unexpectedly.
Oracle_Enterprise_0,0: Failure during execution of operator logic.
Oracle_Enterprise_0,0: Fatal Error: Unable to allocate communication resources

samsuf2002 · Post by **samsuf2002** » Fri Oct 13, 2006 2:54 pm

whst is ur job design, are u using join stage in ur job?

laxmi_etl · Post by **laxmi_etl** » Fri Oct 13, 2006 2:55 pm

simple database to database job with lot of data..

ArndW · Post by **ArndW** » Fri Oct 13, 2006 3:01 pm

There is more to it than a DB stage to DB stage. The "Heap" is used when sorting (or repartitioning), so perhaps you could explain a bit more about what you are doing.

samsuf2002 · Post by **samsuf2002** » Fri Oct 13, 2006 3:04 pm

error due to heap is about allocation of memory resources u need to increase the memory size of the server or try to run fewer jobs simultaneously.

laxmi_etl · Post by **laxmi_etl** » Fri Oct 13, 2006 3:21 pm

This is a simple ORacle to ORacle job

ArndW · Post by **ArndW** » Fri Oct 13, 2006 3:28 pm

Does that mean Oracle to Oracle with no other stages?

laxmi_etl · Post by **laxmi_etl** » Fri Oct 13, 2006 3:55 pm

correct.

ray.wurlod · Post by **ray.wurlod** » Fri Oct 13, 2006 4:03 pm

Many lakhs of rows in a single transation? Note from the message that it is coming from the ODBC driver; this means that something relating to the database has run out of memory - probably your enormous transaction.

kumar_s · Post by **kumar_s** » Fri Oct 13, 2006 11:23 pm

Try to have a commit with long intervals.

Nageshsunkoji · Post by **Nageshsunkoji** » Mon Oct 16, 2006 3:07 am

Hi,

I think, may be here problem is pertaining loading the data from one database to other database with out any stage between them. Just, try out this option, Use a Copy stage between these two stages and try out to load the data. Here Copy Stage work as an optimizer. It will provide buffer to hold the rows while datastage is processing rows.

If you do include a copy stage between the two databases to avoid the space issue, please ensure that property Force is set to "True". Else the copy process will be eliminated for optimization purposes.

Nageshsunkoji · Post by **Nageshsunkoji** » Mon Oct 16, 2006 3:08 am

Hi,

I think, may be here problem is pertaining loading the data from one database to other database with out any stage between them. Just, try out this option, Use a Copy stage between these two stages and try out to load the data. Here Copy Stage work as an optimizer. It will provide buffer to hold the rows while datastage is processing rows.

If you do include a copy stage between the two databases to avoid the space issue, please ensure that property Force is set to "True". Else the copy process will be eliminated for optimization purposes.

Nageshsunkoji · Post by **Nageshsunkoji** » Mon Oct 16, 2006 3:11 am

Hi,

I think, may be here problem is pertaining loading the data from one database to other database with out any stage between them. Just, try out this option, Use a Copy stage between these two stages and try out to load the data. Here Copy Stage work as an optimizer. It will provide buffer to hold the rows while datastage is processing rows.

If you do include a copy stage between the two databases to avoid the space issue, please ensure that property Force is set to "True". Else the copy process will be eliminated for optimization purposes.

kumar_s · Post by **kumar_s** » Mon Oct 16, 2006 3:15 am

Dont you have the buffering property to edit in Database stage output tab?

Nageshsunkoji · Post by **Nageshsunkoji** » Mon Oct 16, 2006 3:15 am

Hi All,

Apologises for the above repeated post, I got some problems in my browser, It have submit my post 3 times.

Regards
Nagesh.