How to Restart Datastage sequence when a job aborts?

dxk9 · Post by **dxk9** » Tue Mar 02, 2010 11:50 pm

Hi,
I want to know how a sequence can be restarted if a job in the sequence aborts. And if the restart is done, what is the process/sequence in which datastage does it?

I searched the forum regarding this, but not sure about the procedure to do it. Can anyone let me know the way to do it without using UNIX scripts.

Regards,
Divya

zulfi123786 · Post by **zulfi123786** » Wed Mar 03, 2010 12:12 am

If you want to do it at datastage level go to director and run it by giving the appropriate parameters it would run as it normally runs only thing would be it will skip the checkpointed onces which ran sucessfully on the prior run.

dxk9 · Post by **dxk9** » Wed Mar 03, 2010 12:30 am

I want to restart it automatically.

Till date, if the sequence aborts cause of a job abort, then I generally reset the job and the restart the sequence manually.

So just wanted to know how to automate it.

Regards,
Divya

Sreenivasulu · Post by **Sreenivasulu** » Wed Mar 03, 2010 1:28 am

Use loop stage and check for status ='2' (abort) . This will re-run the job automatically.

I think this will re-run the job but it will fail again since a job would have aborted due to some 'issue' requiring some 'fix'

Regards
Sreeni

dxk9 · Post by **dxk9** » Wed Mar 03, 2010 4:16 am

I want to re-start the sequence from the point it stopped. Which means :
a. The job which aborted should be reset.
b. The sequence should be restarted.

Guess you got confused between restart and reset.

Regards,
Divya

priyadarshikunal · Post by **priyadarshikunal** » Wed Mar 03, 2010 4:29 am

from sequence set in job properties "Reset if required then run". It will reset the job automatically. Rest it to loop whenever the job aborts.

BTW, for aborted jobs code is 3 not 2.

chulett · Post by **chulett** » Wed Mar 03, 2010 8:03 am

dxk9 wrote:I want to restart it automatically.

No such thing. You could code something but there's no automagical option for this. The aborted child job can be easily reset as noted and you can build a loop of some kind for the sequence itself but how will the actual problem fix itself? Sounds to me like all you're going to get is a constant crash-restart-crash-restart endless loop.

vmcburney · Post by **vmcburney** » Wed Mar 03, 2010 4:32 pm

I wouldn't write off the retry on abort - sometimes a job aborts and then works the next time due to resource conflicts. Sequence jobs have some restart from checkpoint capabilities built in if you enable it in the sequence job properties so if a job called from that sequence aborts the sequence will stop. If you run that sequence again it will start from the job that failed and skip the jobs that worked. If you set you job activity stages to reset and run instead of just run it should reset and run aborted jobs okay.

chulett · Post by **chulett** » Wed Mar 03, 2010 6:41 pm

vmcburney wrote:If you set you job activity stages to reset and run instead of just run it should reset and run aborted jobs okay.

Mmmmaybe. Really depends on why it aborted.

I wasn't suggesting this be written off, just written intelligently. Have some kind of an out, a reasonableness test for 'stuckage' rather than simply spinning in an endless Big Bang. That way leads to increasing entropy, black holes and perhaps even the heat death of the universe.

dxk9 · Post by **dxk9** » Wed Mar 03, 2010 11:27 pm

Yes. The aborts in jobs are mostly cause of the resources, so it runs fine the next time.

So I want to know the entire procedure (step-by-step) to
a. Reset the job which gets aborted.
b. Restart the sequence which got aborted cause of the job abort.
I want the above two things to be done automatically without manual intervention.

Your detailed explaination are highly appreciated.

Thanks in advance.

Regards,
Divya

ray.wurlod · Post by **ray.wurlod** » Wed Mar 03, 2010 11:41 pm

(1) Automatic reset of job is achieved by setting its run mode in the job activity to "reset if required, then run".

(2) Automatic reset of job sequence can only be achieved by running that sequence from a parent sequence, which never aborts.

Note, however, that it is not necessary to reset a Restartable sequence, provided that it is configured not to abort if one of its activities fails.

dxk9 · Post by **dxk9** » Wed Mar 03, 2010 11:57 pm

Ray,
I am not able to view your entire reply cause I am not a premium member

Regards,
Divya

ray.wurlod · Post by **ray.wurlod** » Thu Mar 04, 2010 1:11 am

That, at least, is easily remedied.

dxk9 · Post by **dxk9** » Thu Mar 04, 2010 3:18 am

how can I view your reply without becoming a member

ray.wurlod · Post by **ray.wurlod** » Thu Mar 04, 2010 4:23 am

You can't.

Premium memberships are one of the ways in which the hosting and bandwidth costs of DSXchange are defrayed. By taking premium membership you not only benefit in a number of ways, but can also rejoice in the knowledge that you're helping to keep DSXchange alive. It's not expensive, at less than 30c (Rs 12) per day.