We have one parallel job which loads data into an oracle table from a dataset(as designed below)
Dataset-->Transformer---->Oracle Enterprise Stage
The transformer doesn't have any major transformations apart from doing setnull() for a few fields.
This job took 11 hours to load 40 million records into a partitioned table.This table has 250 columns and indexed on 5 columns.
Settings of Oracle enterprise stage:
Code: Select all
Write Method=Load
Write Mode=append
Disable constraints =true
Execution mode is Default(Parallel) in Stage->advanced tab
Code: Select all
APT_ORACLE_LOAD_OPTIONS has been set by user. Therefore, Orchestrate assumes that the DIRECT and/or PARALLEL options have been set to FALSE, and that it is okay to load table 'Schema1.Table', even though it is indexed, and an index option (rebuild or maintenance) has not been included. APT_ORACLE_LOAD_OPTIONS has been set by the user to 'OPTIONS (DIRECT=TRUE, PARALLEL=FALSE)'.
Any suggetions would be appreciated.
Thanks in advance,
Raja R P