How many jobs we can run at one shot

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rhaddur
Participant
Posts: 52
Joined: Mon Mar 13, 2006 7:33 am
Location: mumbai

How many jobs we can run at one shot

Post by rhaddur »

Hi All,

I am planning to schedule around 100 jobs in Control M ,
These all are independents jobs.

My questions:

1)Is it recomended to run 100 jobs at one shot.

2) Is there any limitations that we can run N jobs at one shot
Rhaddur
Mike
Premium Member
Premium Member
Posts: 1021
Joined: Sun Mar 03, 2002 6:01 pm
Location: Tampa, FL

Post by Mike »

1) Probably not.

2) Depends entirely on the capacity of your platform... disk, memory, network... Nobody here has visibility to your platform. You'll have to work with your system guys to optimize workloads and throughput.

Mike
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

...also how big is your job..!!
rhaddur
Participant
Posts: 52
Joined: Mon Mar 13, 2006 7:33 am
Location: mumbai

Post by rhaddur »

Sainath.Srinivasan wrote:...also how big is your job..!!
each job contains 10 to 12 stage

how this info related to my query
Rhaddur
Mike
Premium Member
Premium Member
Posts: 1021
Joined: Sun Mar 03, 2002 6:01 pm
Location: Tampa, FL

Post by Mike »

Bigger jobs = more required resources = fewer jobs that can run simultaneously.

Mike
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

If you start 10 jobs at exactly the same time then one or more can fail. If you start them a few seconds one after another then you can run more jobs. The start up time is very intense and consumes a lot of system resources. Some systems 10 jobs at once is no problem but idea is the same. Start up is worse or more intense than when the jobs is running.
Mamu Kim
Post Reply