Insertion issues
Posted: Thu Dec 09, 2004 9:32 am
Hi,
Recently, when we were presenting a DataStage solution which contains a simple Oracle to Oracle load of a large table, we were bombarded with a question saying that there could be insertion issues. And their argument is that because of those issues, if the "write" fails, then we need to do a "read" again on the database and then insert the data. So, we were suggested to "write" the data into a flat file first and then do a Bulk load into the table, reading from the flat file so that even if the insert fails, there is no need to read again from the database.
In this regard, I need to know how robust is a DataStage job (OCI to OCI load)? How frequently or under what circumstances the insertion may fail? And is it a better approach to use the Flat file approach than a DataStage stage approach?
Cheers,
Mohan
Recently, when we were presenting a DataStage solution which contains a simple Oracle to Oracle load of a large table, we were bombarded with a question saying that there could be insertion issues. And their argument is that because of those issues, if the "write" fails, then we need to do a "read" again on the database and then insert the data. So, we were suggested to "write" the data into a flat file first and then do a Bulk load into the table, reading from the flat file so that even if the insert fails, there is no need to read again from the database.
In this regard, I need to know how robust is a DataStage job (OCI to OCI load)? How frequently or under what circumstances the insertion may fail? And is it a better approach to use the Flat file approach than a DataStage stage approach?
Cheers,
Mohan