Job Control or Job Sequence for Parallel Development
Moderators: chulett, rschirm, roy
Job Control or Job Sequence for Parallel Development
What do you suggest ? I'm used to Job controls since I have started initially with DS Server Edition. Is it better to switch to sequencers ?
Thanks
Thanks
When you say "for parallel development", does this mean:
a) development in Parallel (Enterprise) Edition of Datastage; or
b) parallel development of code (as in mutiple people working on the same thing at the same time)
Without this being clear, it's hard to gauge what you are asking really, though I do have some views on job sequences.
a) development in Parallel (Enterprise) Edition of Datastage; or
b) parallel development of code (as in mutiple people working on the same thing at the same time)
Without this being clear, it's hard to gauge what you are asking really, though I do have some views on job sequences.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
-
- Premium Member
- Posts: 425
- Joined: Sat Nov 19, 2005 9:26 am
- Location: New York City
- Contact:
Parallel or Server has no bearing on this conversation as either solution is equally valid for both. If you have a robust "job control" solution in place then there may be no need for Sequence jobs, perhaps only leveraging them for any situation that your job control cannot handle, if any.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
OK thanks
Well, here's my two cents...
It really comes down to what level of complexity you need to achieve. Personally, I dislike job control and sequences provide much more flexibility. That said, it depends on your environment. If your scheduling tool allows complex logic for dependencies/rerun/handling etc, then it can often be better to code at a more granular level, avoiding sequences and having a job by job call from the scheduling. Anything in between creates a mix of the two which just confuses standards further.
Sequences also have issues of restartability. Whilst they are restartable from point of failure and restartable from the beginning (reset), they do not permit a partial rerun from a chosen point in the flow, so if you have bundled many jobs in a sequence, you may find yourself manually running parts of this instead. In scheduling, you might have found it easier to "rewind" to a chosen point and start again, in comparison to a sequence-driven design.
In the end, it's just a blend of design consideration along with the tools you have available to you, taking a wider view than the Datastage suite to include scheduling tools.
![Smile :)](./images/smilies/icon_smile.gif)
Well, here's my two cents...
It really comes down to what level of complexity you need to achieve. Personally, I dislike job control and sequences provide much more flexibility. That said, it depends on your environment. If your scheduling tool allows complex logic for dependencies/rerun/handling etc, then it can often be better to code at a more granular level, avoiding sequences and having a job by job call from the scheduling. Anything in between creates a mix of the two which just confuses standards further.
Sequences also have issues of restartability. Whilst they are restartable from point of failure and restartable from the beginning (reset), they do not permit a partial rerun from a chosen point in the flow, so if you have bundled many jobs in a sequence, you may find yourself manually running parts of this instead. In scheduling, you might have found it easier to "rewind" to a chosen point and start again, in comparison to a sequence-driven design.
In the end, it's just a blend of design consideration along with the tools you have available to you, taking a wider view than the Datastage suite to include scheduling tools.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
All a sequence is is a GUI that generates a job control routine (which you can inspect in the job properties window). Sequences are preferred for anyone who is not an expert (and I use that term in its strongest sense) in the DataStage BASIC programming language and in using the DataStage API.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.