I have a job that moves data from one oracle table to another oracle tables. The datastage server and oracle server are physically different. I am getting a speed of only 100 rows per second even if it is a simple transfer of data.
I have OCI -> TRANSFORMER -> OCI stages. The transaction size has been set to zero. The array size is 1000. There are about 7 million rows to be transferred.
This kind of volume processing is only a one-time event. I will appreciate any ideas or help. I would like to know why the simple transfer speed is so low. I get very good speed in other jobs that involve much more data transformation.
Thanks.
Very Slow performance - Table to table data transfer
Moderators: chulett, rschirm, roy
Re: Very Slow performance - Table to table data transfer
Try to use any Bulk Loaders Stages.SonShe wrote:I have a job that moves data from one oracle table to another oracle tables. The datastage server and oracle server are physically different. I am getting a speed of only 100 rows per second even if it is a simple transfer of data.
I have OCI -> TRANSFORMER -> OCI stages. The transaction size has been set to zero. The array size is 1000. There are about 7 million rows to be transferred.
This kind of volume processing is only a one-time event. I will appreciate any ideas or help. I would like to know why the simple transfer speed is so low. I get very good speed in other jobs that involve much more data transformation.
Thanks.
Also try to incorporate IPC stage/stages in your job design, to increase the performance.
You can even specify this at project level.
Thanks