Poor performance Sequential file to Oracle table

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
RPhani
Participant
Posts: 32
Joined: Sun Aug 26, 2012 7:03 am
Location: Hyd

Poor performance Sequential file to Oracle table

Post by RPhani »

Hi Experts,

I am facing a performance issue.
In my Job the Source is Sequential file and Target is Oracle Connector. The job has 2 Lookups and 2 Transformers in the Job design.

In QA:Job fetches records from source sequential file in 450 rows/sec

In Production:The same Job fetches records from source sequential file in 25 rows/sec

Nodes, number of source records are same in both situations.

How can I speed it up in Production.
Why it's fetching speed is low?

Thanks in advance,
Phani
arunkumarmm
Participant
Posts: 246
Joined: Mon Jun 30, 2008 3:22 am
Location: New York
Contact:

Post by arunkumarmm »

Did you check the server load in your production environment? Are there other jobs running at the same time, using more memory which might be affecting this job's performance?
Arun
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Change your output stage to a PEEK stage and compare performance between the environments. I am willing to bet that the difference is in your database writes.
Post Reply