Page 1 of 1

Performance Issue

Posted: Mon Apr 18, 2011 4:01 am
by chandra.shekhar@tcs.com
Performance issue :

Parallel job as follows:

1>Sequential file ---> transformer------->db2connector (upsert method)
2>Job running on datastage 8 node.Array size =2000 ,transaction size =4000,
readers per node=8.

Problem description: While running same job individually it takes 1 min36 sec to process 146000 records. while same job we run from sequencer it takes 4 mints to complete.

Why is it so ? we want to achieve same job should be run in 1 min36 sec using sequencer.

Kindly suggest.

Kishor

Posted: Mon Apr 18, 2011 5:51 am
by zulfi123786
When all parameters set to same in both cases the difference should only be due to multiple jobs running from sequencer which might be using the same database where the bandwhidth is shared.
When this job is running from sequencer observe what others jobs are running simultaniously, it should help understand the reason.

Also did you try running the individual job and from sequencer multiple times or the statistics were just from single run?

Posted: Mon Apr 18, 2011 8:59 am
by asorrell
Is the sequencer changing any paramters? Specifically check to see if it is changing the APT Config file.

Posted: Wed Apr 20, 2011 1:46 am
by chandra.shekhar@tcs.com
zulfi123786 wrote:When all parameters set to same in both cases the difference should only be due to multiple jobs running from sequencer which might be using the same database where the bandwhidth is shared.
When this job is running from sequencer observe what others jobs are running simultaniously, it should help understand the reason.

Also did you try running the individual job and from sequencer multiple times or the statistics were just from single run?

Hi,

I have run the same job individually without sequencer as well as sequencer also for (single same file)

without individually it is taking less time then sequencer .

like 2min.46sec individually and 4min.36sec while using sequencer.

Posted: Wed Apr 20, 2011 1:50 am
by chandra.shekhar@tcs.com
asorrell wrote:Is the sequencer changing any paramters? Specifically check to see if it is changing the APT Config file.

for individual file we are not changing any parameter. All values are hard coded.

Posted: Wed Apr 20, 2011 3:23 am
by ray.wurlod
How long does the job take to start under each circumstance?