Improve the job performance

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ysrini9
Participant
Posts: 108
Joined: Tue Jul 12, 2005 2:51 am

Improve the job performance

Post by ysrini9 »

one of my job in the Daily job scheduling,SLA time is 1:20 mins.

Job design is like

DB2--->Transformer-->DB2(Target)

29th Apr 10 :Num of records processing :23 milions (Row/sec :1575 records from Transformer -->DB2(Target))

28th Apr 10:Num of records processing :23 milions (Row/sec :4780 recordsfrom Transformer -->DB2(Target))

but today this job taken morethan 4 hrs.

how can I improve the performance of this job.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

How can anyone help without any details? :?

What kind of "load" is this? What are you doing with these 23M records on a daily basis? How many nodes? (etc,etc) Some improperly designed loads by their very nature will take longer and longer to run, hence the question.
-craig

"You can never have too many knives" -- Logan Nine Fingers
shivajid2k
Participant
Posts: 19
Joined: Mon Feb 14, 2005 11:34 pm

Re: Improve the job performance

Post by shivajid2k »

What stage are you using? DB2 API or Enterprise?
Post Reply