Job Warning

kumar_s · Post by **kumar_s** » Fri Mar 09, 2007 4:24 am

Not necessarily. If its a shell script which is ready to call the jobs, why it should be again called from Job Sequence. You can directly call it from Command prompt, or schedule it.

DSguru2B · Post by **DSguru2B** » Fri Mar 09, 2007 7:51 am

True, shells are written as part of the control process. Shells control jobs, not the other way around.

kumar_s · Post by **kumar_s** » Fri Mar 09, 2007 7:57 am

But I have seen in some places, for some reason the shell scripts are called again in Datastage Job Sequence. I guess oacvb is part of that victim.

DSguru2B · Post by **DSguru2B** » Fri Mar 09, 2007 7:59 am

I have seen scripts being invoked from jobs as well. But these are mostly for reasons other than control. Otherwise the control becomes confusing and linked in various ways. I am not a big fan of that design.

oacvb · Post by **oacvb** » Sun Mar 11, 2007 5:17 pm

Exactly, As DSGuru mentioned, Shell are called for some other purpose not to control jobs. Else it will be difficult to control jobs

kumar_s · Post by **kumar_s** » Sun Mar 11, 2007 6:53 pm

oacvb wrote:Exactly, As DSGuru mentioned, Shell are called for some other purpose not to control jobs. Else it will be difficult to control jobs

But we were talking about the Shell scripts that use to control job flow which involves 'dsjob -run' command in it.

DSguru2B · Post by **DSguru2B** » Sun Mar 11, 2007 7:03 pm

I think what oacvb was trying to say is
"Exactly, As DSGuru mentioned, Shell's within a job are called for some other purpose not to control jobs. Else it will be difficult to control jobs."

oacvb · Post by **oacvb** » Sun Mar 11, 2007 7:06 pm

Yes guru. You understood correctly.

kumar_s · Post by **kumar_s** » Sun Mar 11, 2007 7:11 pm

Am I missing out something.
The job is aborting if called from Datastage director based on the setting available in each Client. If its really required to avoid that, the suggested option is to call the Job using Shell script which involves 'dsjob -run' command. Hence '-warn' option can be fixed and not does not vary based on each client settings. And this Shell script can be called via command line or scheduler. So where comes the job, that calls the shell script.

oacvb · Post by **oacvb** » Sun Mar 11, 2007 7:25 pm

If i understood correctly, are you asking me use Unix Scheduler instead of scheduling at Director ? What if i need to call the sequencer repeatedly. It might lead on writing some more jobs as a cover.

Else i can give other scenario, I have a Job sequence which calls 20 Jobs. Assuming one of the job fails and wanted to trigger it. Won't lead to the same issue if option is not set at project level. Performance might degrade if you call script instead of jobs directly from job sequence. Because CPU has to spent for execution / status maintain for the scripts.

kumar_s · Post by **kumar_s** » Sun Mar 11, 2007 7:28 pm

Basically Datastage uses the OS scheduler, it doesn't have its own.
And to answer you question, you need to call the JobSequence which calls the list of jobs again from script. The restartable option is at JobSequence level.
If you need to add any jobs, you are free to add in JobSequence.

oacvb · Post by **oacvb** » Sun Mar 11, 2007 7:38 pm

Exactly. Not sure whether you understood correctly or not.

The issue here not with job sequence. It's all with job. To make it clear.

I have Jobs J 1, J 2, J 3...J 20

Job Sequence S 1

Now S 1 Calls J 1, J 2 sequentially and waits for completion of both J 1 and J 2. then J 3, J 4...J 20 called parallely. Now what if J 11 fails and wanted to re-trigger J 11 alone and S 1 won't fail because of failure of Job J 11. Won't be better if you have job warn setting at project level.

kumar_s · Post by **kumar_s** » Sun Mar 11, 2007 7:42 pm

"S1 won't fail because of failure of Job J 11"
As I mentioned, S1 should fail when J11 fails. This can be acheived using options available at JobSequence and Job properties in order to maintain restrartablility.

oacvb · Post by **oacvb** » Sun Mar 11, 2007 7:48 pm

It's leading to somewhere i guess. I wanted not to fail Job Seqeunce and wanted to restart only the failed job. Hope it is clear to you now.

kumar_s · Post by **kumar_s** » Sun Mar 11, 2007 7:49 pm

You cannot restart a failed Job from a restart point from a Jobsequence unless the Jobsequence is failed.