DSXchange

I have a job that moves data from one oracle table to another oracle tables. The datastage server and oracle server are physically different. I am getting a speed of only 100 rows per second even if it is a simple transfer of data.

I have OCI -> TRANSFORMER -> OCI stages. The transaction size has been set to zero. The array size is 1000. There are about 7 million rows to be transferred.

This kind of volume processing is only a one-time event. I will appreciate any ideas or help. I would like to know why the simple transfer speed is so low. I get very good speed in other jobs that involve much more data transformation.

Thanks.

SonShe wrote:I have a job that moves data from one oracle table to another oracle tables. The datastage server and oracle server are physically different. I am getting a speed of only 100 rows per second even if it is a simple transfer of data.

I have OCI -> TRANSFORMER -> OCI stages. The transaction size has been set to zero. The array size is 1000. There are about 7 million rows to be transferred.

This kind of volume processing is only a one-time event. I will appreciate any ideas or help. I would like to know why the simple transfer speed is so low. I get very good speed in other jobs that involve much more data transformation.

Thanks.

Try to use any Bulk Loaders Stages.

Also try to incorporate IPC stage/stages in your job design, to increase the performance.
You can even specify this at project level.

Thanks

Are there any 'transformations' involved? If not, I wouldn't even use DataStage for something like this.