sequence job restarting problem

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

ds_team
Participant
Posts: 48
Joined: Sun Dec 03, 2006 12:18 am

sequence job restarting problem

Post by ds_team »

I have a sequence of jobs in my main job named "abc". I if any one of my job in my main job aborts, i want the main job to run from that particular point it got aborted, if i restart the main job. is this possible. if so please let me know the solution.
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

Yes, check the "Add checkpoints so sequence is restartable on failure"
in the Compilation Options of the Job Sequence.
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

What 7x version of DataStage, exactly?
-craig

"You can never have too many knives" -- Logan Nine Fingers
ds_team
Participant
Posts: 48
Joined: Sun Dec 03, 2006 12:18 am

Post by ds_team »

We are using 7.5.1
chulett wrote:What 7x version of DataStage, exactly? ...
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Then between what Narasimha wrote and the 'Automatically handle activities that fail' option, you're all set. Just wanted to double-check as this functionality wasn't available in early versions.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ds_team
Participant
Posts: 48
Joined: Sun Dec 03, 2006 12:18 am

Post by ds_team »

yes we do have those options and we did check that. Once after running this i can confirm the result. thanks for all your replies :)
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Restart will happen only upon failure. If you job finishes with warnings, the DSEngine will consider it "a finished" job and run from the next job onwards. Just to give you a heads up :P
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

DSguru2B wrote:Restart will happen only upon failure. If you job finishes with warnings, the DSEngine will consider it "a finished" job and run from the next job onwards. Just to give you a heads up :P
Since the job status is (Finished with warnings), it is considered as finished unless the warning is promoted to fatal Error.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
mystuff
Premium Member
Premium Member
Posts: 200
Joined: Wed Apr 11, 2007 2:06 pm

Post by mystuff »

Since the job status is (Finished with warnings), it is considered as finished unless the warning is promoted to fatal Error.
How do we promote the warnings as fatal. Even a single error I want to have the job to abort.

Right now I have

a) Execution Action :Reset if required, then run
b) Triggers : Expression Type : OK - (Conditional)
c) Checked
- Add checkpoints so sequence is restartable on failure
- Automatically handle activities that fail
- Log warnings after activities that finish with status other than OK
- Log report messages after each job run

Still I do get the error as Finished (with warnings) instead of abort
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Set the warning limit to 1.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
mystuff
Premium Member
Premium Member
Posts: 200
Joined: Wed Apr 11, 2007 2:06 pm

Post by mystuff »

Yes I have set the warning limit as 1 in the director

A follow on question - how do we set this when we run the jobs through unix script
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

Check the options for thedsjob command. In specific -warn
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
michaeld
Premium Member
Premium Member
Posts: 88
Joined: Tue Apr 04, 2006 8:42 am
Location: Toronto, Canada

Re: sequence job restarting problem

Post by michaeld »

ds_team wrote:if i restart the main job. is this possible.
No, if you reset the job then it will run from start. What you need to do is run it again without reseting and it will continue from where it left off. This is assuming that you check of that the job is restartable in the job properties window.
Mike
mystuff
Premium Member
Premium Member
Posts: 200
Joined: Wed Apr 11, 2007 2:06 pm

Post by mystuff »

Right now I have

a) Execution Action :Reset if required, then run
b) Triggers : Expression Type : OK - (Conditional)
c) Checked
- Add checkpoints so sequence is restartable on failure
- Automatically handle activities that fail
- Log warnings after activities that finish with status other than OK
- Log report messages after each job run
Yes I have set the warning limit as 1 in the director
Even if I have the above set up. I am still finding "Finished with Warnings". And when I run the sequence it starts from the beginning.

I have looked at the job activity and its neighbouring job activities to check whether I have done everything (ie. a & b) as in first quote. Its look ok, but I am unable to understand why I am obtaining finished with warnings.

Note.: this was in a sequence calling a sequence which in turn calls a sequence.[/quote]
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

mystuff wrote:Its look ok, but I am unable to understand why I am obtaining finished with warnings.
:? A little lost. You don't understand where the warnings are coming from? Or are you trying to get it to abort so that your Sequence is restartable, but only get warnings instead?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply