scheduling - possible corruption issue
Posted: Tue May 03, 2016 7:53 am
Curious how many others have run into this over the years and if anyone has a better solution...
When you schedule a repeating job from Director, it appears that the default parameter values are evaluated at the time of creating the schedule, and stored off to the side.... somewhere, instead of DataStage evaluating the default parameter values at the time of job execution.
Q1. Why is this the default behavior? Does anyone find this to be a good thing? There must be some benefit, not sure what. What I have noticed is that it leads to a lot of unexpected and unpleasant surprises followed by a lot of rescheduling.
Q2. Where are the scheduled jobs' parameter values getting stored?
Q3. Is it a known issue that encrypted parameter values (i.e. passwords) frequently get corrupted during the process of DataStage storing them somewhere at the time of creating the schedules?
We keep getting bit by this over and over. Scheduled jobs will sometimes abort due to invalid password. BUT, when you manually restart the same unchanged aborted sequence, not having changed or reset the password, the same job completes successfully. Hence, the password is actually valid.
I have searched other posts and pretty much only found the suggestion to try, try again, by deleting the schedule and recreating it. I think the implication is that perhaps one day you will get lucky and DataStage won't corrupt the password as it creates the schedule.
When you schedule a repeating job from Director, it appears that the default parameter values are evaluated at the time of creating the schedule, and stored off to the side.... somewhere, instead of DataStage evaluating the default parameter values at the time of job execution.
Q1. Why is this the default behavior? Does anyone find this to be a good thing? There must be some benefit, not sure what. What I have noticed is that it leads to a lot of unexpected and unpleasant surprises followed by a lot of rescheduling.
Q2. Where are the scheduled jobs' parameter values getting stored?
Q3. Is it a known issue that encrypted parameter values (i.e. passwords) frequently get corrupted during the process of DataStage storing them somewhere at the time of creating the schedules?
We keep getting bit by this over and over. Scheduled jobs will sometimes abort due to invalid password. BUT, when you manually restart the same unchanged aborted sequence, not having changed or reset the password, the same job completes successfully. Hence, the password is actually valid.
I have searched other posts and pretty much only found the suggestion to try, try again, by deleting the schedule and recreating it. I think the implication is that perhaps one day you will get lucky and DataStage won't corrupt the password as it creates the schedule.