Hi All,
Can anybody explain me about the practical advantage of executing multiple instances of DataStage Job. In which scenario I can go for this?
Regards
Prasad
Multiple instances of DataStage Job
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 10
- Joined: Thu Mar 18, 2004 12:08 am
Multi instance jobs can be used when say you want to do the same type of processing for multiple input files.
Rather than running the same jobs over and over again you could created routes using which you could process multiple files together.
If you didnt have multi instancing you would have had to make copies of these jobs, now you just call the same multi instance enabled job, just by passing a different invocation id as many times as you like.
Rather than running the same jobs over and over again you could created routes using which you could process multiple files together.
If you didnt have multi instancing you would have had to make copies of these jobs, now you just call the same multi instance enabled job, just by passing a different invocation id as many times as you like.
-
- Participant
- Posts: 10
- Joined: Thu Mar 18, 2004 12:08 am
Multiple instances are incredibly useful for partitioning datastreams and using multiple copies of the job to process the data. Why have 1 job crunch the numbers on a 16 cpu system when you can have 16 copies of the job with each crunching 1/16th of the input datastream.
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 70
- Joined: Thu Aug 14, 2003 6:24 am
- Contact:
For example, if you want to process data from different geographical areas (time zones) due to volume of data and provide data to users in those areas as soon as you finish. In that case you need to process data using same methodology with different parameters. You can use multiple instances of the jobs or copies of the same jobs. But Multiple instances will give you more flexibility for scheduling etc....
Sree
Sree
-
- Premium Member
- Posts: 29
- Joined: Wed Mar 22, 2017 10:45 pm