multiple standalone jobs in one job - any performance gain?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
raiva1
Participant
Posts: 4
Joined: Thu Apr 26, 2007 5:00 am

multiple standalone jobs in one job - any performance gain?

Post by raiva1 »

Hi All,

I have four mappings to load four different tables which are independent of each other, and each has different source

TableSrc1 --------------> TableTgt1
TableSrc2 --------------> TableTgt2
TableSrc3 --------------> TableTgt3
TableSrc4 --------------> TableTgt4

Now I want to know what and how different is it when I create 4 different jobs for each mapping and when I create 1 job which has all the four mappings in it?

Does creating 1 job for all the four mappings give me any performance benifit?


Thanks!!!!!

Rai
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: multiple standalone jobs in one job - any performance ga

Post by chulett »

Welcome! :D
raiva1 wrote:Does creating 1 job for all the four mappings give me any performance benifit?
No. In my opinion, there are no 'pros' and all 'cons' to this approach. If there are any dependancies on any of these jobs, you now need to wait for all jobs to complete. The bigger issue to me is restartability - one load has a problem and you need to rerun all four. :evil:
-craig

"You can never have too many knives" -- Logan Nine Fingers
hemachandra.m
Participant
Posts: 27
Joined: Wed Jan 03, 2007 1:29 am

Re: multiple standalone jobs in one job - any performance ga

Post by hemachandra.m »

Having 4 load in the same job will not improve performance.

But for performance have 4 loads in 4 different jobs and in the sequencer make them to run in parallel. This will improve the performance a lot.
Hemachandra
raiva1
Participant
Posts: 4
Joined: Thu Apr 26, 2007 5:00 am

Post by raiva1 »

Thanks chullet and hemachandra !!!!.

I had not thought about the restartability issue and sequencer.
I will explore the sequencer option now though.

Rai
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Well... running them in a Sequence job or in a single Server job with no dependencies between the job streams will both run all four 'in parallel'. It's just that you have restartability and other options available in the Sequence job that you don't have in your original approach.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply