DSXchange

Any thoughts on below error??


APT_CombinedOperatorController,0: Current heap size: 1,595,049,352 bytes in 66,276,970 blocks
BC_Enterprise_6,0: Failure during execution of operator logic.
ODBC_Enterprise_6,0: Input 0 consumed 1616342 records.
APT_CombinedOperatorController,0: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
node_node1: Player 2 terminated unexpectedly.
PT_CombinedOperatorController,1: Current heap size: 1,595,049,328 bytes in 66,276,969 blocks
ODBC_Enterprise_6,1: Failure during execution of operator logic.
APT_CombinedOperatorController,1: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed.
ode_node2: Player 1 terminated unexpectedly.
Oracle_Enterprise_0,0: Failure during execution of operator logic.
Oracle_Enterprise_0,0: Fatal Error: Unable to allocate communication resources

whst is ur job design, are u using join stage in ur job?

simple database to database job with lot of data..

There is more to it than a DB stage to DB stage. The "Heap" is used when sorting (or repartitioning), so perhaps you could explain a bit more about what you are doing.

error due to heap is about allocation of memory resources u need to increase the memory size of the server or try to run fewer jobs simultaneously.

This is a simple ORacle to ORacle job

Does that mean Oracle to Oracle with no other stages?

correct.

Many lakhs of rows in a single transation? Note from the message that it is coming from the ODBC driver; this means that something relating to the database has run out of memory - probably your enormous transaction.

Try to have a commit with long intervals.

Hi,

I think, may be here problem is pertaining loading the data from one database to other database with out any stage between them. Just, try out this option, Use a Copy stage between these two stages and try out to load the data. Here Copy Stage work as an optimizer. It will provide buffer to hold the rows while datastage is processing rows.

If you do include a copy stage between the two databases to avoid the space issue, please ensure that property Force is set to "True". Else the copy process will be eliminated for optimization purposes.

Hi,

I think, may be here problem is pertaining loading the data from one database to other database with out any stage between them. Just, try out this option, Use a Copy stage between these two stages and try out to load the data. Here Copy Stage work as an optimizer. It will provide buffer to hold the rows while datastage is processing rows.

If you do include a copy stage between the two databases to avoid the space issue, please ensure that property Force is set to "True". Else the copy process will be eliminated for optimization purposes.

Hi,

I think, may be here problem is pertaining loading the data from one database to other database with out any stage between them. Just, try out this option, Use a Copy stage between these two stages and try out to load the data. Here Copy Stage work as an optimizer. It will provide buffer to hold the rows while datastage is processing rows.

If you do include a copy stage between the two databases to avoid the space issue, please ensure that property Force is set to "True". Else the copy process will be eliminated for optimization purposes.

Dont you have the buffering property to edit in Database stage output tab?

Hi All,

Apologises for the above repeated post, I got some problems in my browser, It have submit my post 3 times.

Regards
Nagesh.