Loading data into Oracle DB is slow
Posted: Thu Jul 29, 2010 12:55 pm
Hi,
I am trying to load nearly 10 million of data into a Oracle table (Trunc and load) using the ODBC stage from a CSV file. It's really taking long time like 1200 rows/sec.
I can't use the Oracle Enterprise stage for doing trucate and load, because in my company we dont have access to drop and create the indexes as Oracle drops the indexes and recreates them if we use the trunc and load.
my job sequece is:
Sequencial file stage -> column generator -> transformer -> DB
i am using the column generator to create the surrogate key.
Can you please advice me how can i improve the performance?
I am trying to load nearly 10 million of data into a Oracle table (Trunc and load) using the ODBC stage from a CSV file. It's really taking long time like 1200 rows/sec.
I can't use the Oracle Enterprise stage for doing trucate and load, because in my company we dont have access to drop and create the indexes as Oracle drops the indexes and recreates them if we use the trunc and load.
my job sequece is:
Sequencial file stage -> column generator -> transformer -> DB
i am using the column generator to create the surrogate key.
Can you please advice me how can i improve the performance?