scheduling - possible corruption issue

qt_ky · Post by **qt_ky** » Tue May 03, 2016 7:53 am

Curious how many others have run into this over the years and if anyone has a better solution...

When you schedule a repeating job from Director, it appears that the default parameter values are evaluated at the time of creating the schedule, and stored off to the side.... somewhere, instead of DataStage evaluating the default parameter values at the time of job execution.

Q1. Why is this the default behavior? Does anyone find this to be a good thing? There must be some benefit, not sure what. What I have noticed is that it leads to a lot of unexpected and unpleasant surprises followed by a lot of rescheduling.

Q2. Where are the scheduled jobs' parameter values getting stored?

Q3. Is it a known issue that encrypted parameter values (i.e. passwords) frequently get corrupted during the process of DataStage storing them somewhere at the time of creating the schedules?

We keep getting bit by this over and over. Scheduled jobs will sometimes abort due to invalid password. BUT, when you manually restart the same unchanged aborted sequence, not having changed or reset the password, the same job completes successfully. Hence, the password is actually valid.

I have searched other posts and pretty much only found the suggestion to try, try again, by deleting the schedule and recreating it. I think the implication is that perhaps one day you will get lucky and DataStage won't corrupt the password as it creates the schedule.

chulett · Post by **chulett** » Tue May 03, 2016 8:01 am

Wow, that's still going on? From what I recall, it does stash them somewhere so cron has access to them but don't recall the where. And I seem to recall a change to a schedule possibly triggering that so we would delete and recreate it instead. Sorry, got nothing else except this right now:

I think you can look at the crontab entry to see some of the secret sauce behind this... and guessing you'll need to ask support for the why of it. Goes back well before the concept of parameter sets and value files were introduced, FWIW.

johnboy3 · Post by **johnboy3** » Tue May 03, 2016 9:41 am

We are not currently scheduling any jobs, but we may want to.

This seems pretty important to me, and I want to know the answer, too.
john3

FranklinE · Post by **FranklinE** » Tue May 03, 2016 11:59 am

Not sure if this helps: wrap the job in a job sequence that itself contains none of the parameters in the job to be executed. Seems to me that should force the default values be evaluated at runtime.

qt_ky · Post by **qt_ky** » Wed May 04, 2016 6:22 am

Franklin, that is a great idea! I am going to test it. Thanks.

ray.wurlod · Post by **ray.wurlod** » Wed May 04, 2016 4:55 pm

The parameter values entered when a job is (re-)scheduled are stored in one of the hashed files in the local DataStage repository.