Job Control General Question

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Thibal
Participant
Posts: 56
Joined: Tue Mar 30, 2004 3:43 am
Location: Nanterre, France

Job Control General Question

Post by Thibal »

Hi,

I would like to know your expert opinion.

I'm using DataStage for almost 2 years and I've always used "Server Job" Job Control to sequence my jobs (->in BASIC DataStage) and I use routines to :
- check if a file exists before launch
- launch jobs
- analyse job Status and logs and generate my own logs in a flat file.
- etc ... Image

I know, I can do the same in a Job Sequence by adding a Routine Activity before and after each Job Activity. But this solution doesn't look "clean" to me.

What is the "standard" solution ?? Image

Thanks a lot. Image
Thibault

P.S : I hope the answer can't be found easily because I wasn't able to ... :oops:
Thibault Hamel
Nanterre - France
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

#@$%@#$%^&*$^*!@#$@#$^%^*(%^(&*%^&*
In English,
What is that you want to achieve through Job Sequence which you think its not feasible.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Thibal
Participant
Posts: 56
Joined: Tue Mar 30, 2004 3:43 am
Location: Nanterre, France

Post by Thibal »

( I think speaking french is a very bad idea. I hope you won't be punished for that Image )

OK, there's no miracle solution. Too bad ...
Merci :wink:
Thibault Hamel
Nanterre - France
Thibal
Participant
Posts: 56
Joined: Tue Mar 30, 2004 3:43 am
Location: Nanterre, France

Post by Thibal »

kumar_s wrote:#@$%@#$%^&*$^*!@#$@#$^%^*(%^(&*%^&*
In English,
What is that you want to achieve through Job Sequence which you think its not feasible.
I didn't say I can't do it through Job Sequence, I said that the solution I found is not "clean" and I was hoping for better solutions : a "standard" solution ...
Thibault Hamel
Nanterre - France
I_Server_Whale
Premium Member
Premium Member
Posts: 1255
Joined: Wed Feb 02, 2005 11:54 am
Location: United States of America

Post by I_Server_Whale »

Hi Thibal,

What makes you say that the solution is not clean. You should support your statements with facts rather than accusing the job sequence.

I think that job sequences have evolved over time and they work charmingly these days.

On a second thought, people just choose between 'Job sequences' and 'Job Control' depending on their comfort level with either one of them.

It would be great if you could explain why you think that job sequences are not clean.

You always put some amazing emoticons on your posts. How do you do that? Good Emoticons.

Thanks,
Naveen.
Anything that won't sell, I don't want to invent. Its sale is proof of utility, and utility is success.
Author: Thomas A. Edison 1847-1931, American Inventor, Entrepreneur, Founder of GE
Thibal
Participant
Posts: 56
Joined: Tue Mar 30, 2004 3:43 am
Location: Nanterre, France

Post by Thibal »

I think it's not clean because for 1 job activity, there are 2 routine activities around.
So, if you add other jobs, it becames complicated 3 times faster (my sentence doesn't look like english Image)

With all these routine activities, the presentation isn't clean. I'm agree that Job Control presentation is worst ...

That's all I want to say, I don't criticize Job Sequence. I was just asking if a simpler solution exists.



( For the emoticons, I just use the [IMG] and insert my own smiley)
Last edited by Thibal on Fri Feb 24, 2006 10:15 am, edited 1 time in total.
Thibault Hamel
Nanterre - France
gbusson
Participant
Posts: 98
Joined: Fri Oct 07, 2005 2:50 am
Location: France
Contact:

Post by gbusson »

naveen,

it is obvious that Job Controls are more flexible than Job Sequences!

You can't dynamically set parameters to a job activity, maintenance is harder when you have to add a parameter to all the jobs, etc...

But Job Sequences are very useful for many ways!

I was saying that there is no miracle solution.

My way :

Use Job Sequence when you have to treat small treatment units.

Otherwise, use Job Controls.
Thibal
Participant
Posts: 56
Joined: Tue Mar 30, 2004 3:43 am
Location: Nanterre, France

Post by Thibal »

gbusson wrote:My way :

Use Job Sequence when you have to treat small treatment units.

Otherwise, use Job Controls.
It's loud and clear Image
Thibault Hamel
Nanterre - France
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

gbusson wrote:naveen,

it is obvious that Job Controls are more flexible than Job Sequences!

You can't dynamically set parameters to a job activity, maintenance is harder when you have to add a parameter to all the jobs, etc...
Still parameter values can be passed dynamically from shell scripts using dsjob -param to the sequence...
Its all in the way we use the available technology. Still people are comfortable to use PL/SQL for whole ETL process. It varies and depends on the person to person. And how effective you use it.
You can drag and drop the job into pallet click on compile to get an instant job Control for the whole set.
You can built a built a long time consuming, Robust job control. Option is in the hand of beholder.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
gbusson
Participant
Posts: 98
Joined: Fri Oct 07, 2005 2:50 am
Location: France
Contact:

Post by gbusson »

kumar,

Thibal would like to know some opinions about job sequences, that's what i did.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

gbusson wrote:kumar,

Thibal would like to know some opinions about job sequences, that's what i did.
And again, there is nothing wrong i said about you post. :roll:
I just want to quote that there is the possibility to pass the parameter values to Job sequence it self. :D
After all, this is a forum where we can all share our knowledge and thoughts and opinion among all. 8)
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I am beginning to believe that job sequences (at version 7.5) can do pretty much anything you need, with a bit of care and forethought. Using job sequences will offer some protection against the day when "they" decide to drop the use of BASIC (though that's not any time soon).

Bonne chance!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chucksmith
Premium Member
Premium Member
Posts: 385
Joined: Wed Jun 16, 2004 12:43 pm
Location: Virginia, USA
Contact:

Post by chucksmith »

99.999% of the time, I have found the benefit from moving to a visual approach to job control is priceless. I think this even applies to putting RoutineActivity stages around each JobActivity stage. You can convey your intent visually with proper naming conventions. In traditional JCL, we called them comments.

Still, I find many developers only scratching the surface of the capabilities of job sequences. So, I dare you all to stop writing JCL for a month, and force yourselves to implement job control with sequences. It is worth the effort for you, and especially for the next person who must support your code.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I've met that challenge in the last eight out of eight months. 8)
Guess that makes the point a strongly as anything else I may have posted.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
manishsk
Participant
Posts: 13
Joined: Mon Mar 14, 2005 9:37 pm

Post by manishsk »

My client forces me to use Job Sequencers.

Reason: We can use those sequencers as part of ETL Technical Specification Document. The visual view can help to understand the flow of the DS Jobs and same can be used as part of documentation.

Still the question remains if there are lot of activities and jobs its simply difficult to go for sequencers.

I have worked on modules which involved around 150 - 200 jobs running one shot. At such place I can't go for sequencers. :(

So I think if your module involves around 20 to 25 activities go for sequencers, O.W. Job Control (BASIC code) is always a Best way. :wink:
Post Reply