Job Control or Job Sequence for Parallel Development

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
algfr
Participant
Posts: 106
Joined: Fri Sep 09, 2005 7:42 am

Job Control or Job Sequence for Parallel Development

Post by algfr »

What do you suggest ? I'm used to Job controls since I have started initially with DS Server Edition. Is it better to switch to sequencers ?

Thanks
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

When you say "for parallel development", does this mean:

a) development in Parallel (Enterprise) Edition of Datastage; or
b) parallel development of code (as in mutiple people working on the same thing at the same time)

Without this being clear, it's hard to gauge what you are asking really, though I do have some views on job sequences.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
JRodriguez
Premium Member
Premium Member
Posts: 425
Joined: Sat Nov 19, 2005 9:26 am
Location: New York City
Contact:

Post by JRodriguez »

Sequences are the way to go ....
Julio Rodriguez
ETL Developer by choice

"Sure we have lots of reasons for being rude - But no excuses
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

I differ slightly there. Sequences might be the way to go :)
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
algfr
Participant
Posts: 106
Joined: Fri Sep 09, 2005 7:42 am

Post by algfr »

Sorry if I was not clear. I mean that my elementary jobs are parallel jobs. i'm the only one developing
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Parallel or Server has no bearing on this conversation as either solution is equally valid for both. If you have a robust "job control" solution in place then there may be no need for Sequence jobs, perhaps only leveraging them for any situation that your job control cannot handle, if any.
-craig

"You can never have too many knives" -- Logan Nine Fingers
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

OK thanks :)

Well, here's my two cents...

It really comes down to what level of complexity you need to achieve. Personally, I dislike job control and sequences provide much more flexibility. That said, it depends on your environment. If your scheduling tool allows complex logic for dependencies/rerun/handling etc, then it can often be better to code at a more granular level, avoiding sequences and having a job by job call from the scheduling. Anything in between creates a mix of the two which just confuses standards further.

Sequences also have issues of restartability. Whilst they are restartable from point of failure and restartable from the beginning (reset), they do not permit a partial rerun from a chosen point in the flow, so if you have bundled many jobs in a sequence, you may find yourself manually running parts of this instead. In scheduling, you might have found it easier to "rewind" to a chosen point and start again, in comparison to a sequence-driven design.

In the end, it's just a blend of design consideration along with the tools you have available to you, taking a wider view than the Datastage suite to include scheduling tools.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
algfr
Participant
Posts: 106
Joined: Fri Sep 09, 2005 7:42 am

Post by algfr »

Great thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

All a sequence is is a GUI that generates a job control routine (which you can inspect in the job properties window). Sequences are preferred for anyone who is not an expert (and I use that term in its strongest sense) in the DataStage BASIC programming language and in using the DataStage API.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply