Performance Issue

reddy · Post by **reddy** » Thu Aug 17, 2006 5:00 pm

Hi Guys,

I am loading 15 million data from flat file into a oracle table.

Currently it is taking almost 4 hours.

Can you please provide me suggestions to improve performance.

Thanks in advance.
Reddy

narasimha · Post by **narasimha** » Thu Aug 17, 2006 5:08 pm

What stage are you using to load data into your oracle table

I dont think you are using Oracle Bulk loader. Try it.
You will get your job done in less than 1/3 of your time.

kris007 · Post by **kris007** » Thu Aug 17, 2006 5:17 pm

Apart from the above question, What is your Update action set to? What is your Array Size set to? How many columns are you loading into the Oracle table? Are you performing any complex calculations in the Transformer Stage, If so, are you using StageVariables effectively? These are few things you might need to look at to improve your speed. But, IMO it depends largely on the number of columns(average length of each record) you have in the target table.

DSguru2B · Post by **DSguru2B** » Thu Aug 17, 2006 10:24 pm

'Performance' is a relative word. Relative to your environment, record size, depth of transformations, network traffic, database utilization. For millions of records, a logged activity is not advisable. Use the load method. Its a good thing that your data is in a flat file. Invoke the Ora bulk loader by sourcing it in a simple two lined script.
More info is needed on your part to be able to fine tune your job.