Bulk transfer between oracle databases/tables ?

bond88 · Post by **bond88** » Tue May 14, 2013 1:58 pm

Hi,
I am working on a simple task which is just copy data from one table to another table. Number of rows on the table are 28 million. Can anyone suggest the best/efficient way to transfer data between two databases using datastage ?

Thank you,

prasson_ibm · Post by **prasson_ibm** » Tue May 14, 2013 2:45 pm

Hi,
If your source table is partitioned,then you can extract source data in parallel and at taeget you can use bulk load method in connector stage.

bond88 · Post by **bond88** » Tue May 14, 2013 3:03 pm

Thanks Prasson,
I haven't used partition in source tables. Is it possible for you to throw some light on me.

Thank you,

eph · Post by **eph** » Wed May 15, 2013 3:25 am

Hi,

You don't necessarily need to have partitioned tables to use a partitioned read method.
For Oracle, see http://pic.dhe.ibm.com/infocenter/iisin ... reads.html
For DB2, you have 3 partitioning methods, a modulus on a column, a max/min range on a column, or DB2's internal partitioning method.

Eric

bond88 · Post by **bond88** » Wed May 15, 2013 9:25 am

I partitioned source table using Rowid range under Oracle connector. But the thing is I can't able to enable bulk load under target oracle connector. How can I use bulk load ?

Thanks,

prasson_ibm · Post by **prasson_ibm** » Wed May 15, 2013 11:28 am

Hi Eph,
I already tried to use the partition method in source oracle connector stage.I used ROWID HASH partition method to distribute data on nodes(my table is not partitioned).but data is duplicated on nodes,can you please suggest me why its happening?