very poor performance while loading into oracle tables

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
sheema
Premium Member
Premium Member
Posts: 204
Joined: Sat Jul 22, 2006 10:20 am

very poor performance while loading into oracle tables

Post by sheema »

My job uses a flat-file as source that passes through a transformer, where 7 or 8 new fields are appended with some values and then
i have 4 hash files as lookups to 2nd transformer.I check if row exists i perform an update operation or else insert operation into Oracle via 2 OCI stages. The problem is it starts loading about 250 rows/sec and starts decreasing steadily, finally to 1 row/sec.
I have set the array size to 100 and transaction size to 200 for both Insert and Update operation.can anyone help me with reason for rows/sec decreasing.

Thanks
sheema
rleishman
Premium Member
Premium Member
Posts: 252
Joined: Mon Sep 19, 2005 10:28 pm
Location: Melbourne, Australia
Contact:

Post by rleishman »

Try some of these suggestions: viewtopic.php?t=95526
Ross Leishman
Krazykoolrohit
Charter Member
Charter Member
Posts: 560
Joined: Wed Jul 13, 2005 5:36 am
Location: Ohio

Post by Krazykoolrohit »

Check out the warning log. there must be a lot of warnings. Get rid of those and your job will run faster.

Warning are basically caused due to data mismatch issues. check for all these kind of stuff.
sheema
Premium Member
Premium Member
Posts: 204
Joined: Sat Jul 22, 2006 10:20 am

Post by sheema »

I did not get any warnings.
But when i created Indexes on the table today,it is running fine.
Thanks for the help.

Thanks
sheema
Post Reply