Scheduling a job with input file frequency unknown

dsx_newbie · Post by **dsx_newbie** » Thu Jan 04, 2007 4:13 am

What is the best way to schedule if the frequency of the input file is unknown?

Should I create a shell script that checks if the input file is existing in the input directory, if existing the shell script runs the job.

Is there another/best way of doing this?

TIA

wnogalski · Post by **wnogalski** » Thu Jan 04, 2007 4:24 am

You can use "Wait For File Activity" in your sequence.

DSguru2B · Post by **DSguru2B** » Thu Jan 04, 2007 7:33 am

Or if you are using an enterprise scheduler like Control-M or Tivoli, they have a file watcher in place. You can utilize that as well.

chulett · Post by **chulett** » Thu Jan 04, 2007 7:41 am

All would work and be fine, not sure any one is 'best' or especially better than the other unless it more closely aligns with your company's standards.

In any case, the job (or script) could be scheduled and run each day and if there's nothing to do then do not run the processing job. If you want to keep it all in DataStage, then the WFF suggestion is best as you can set it to wait for 'zero seconds' and what you get is a one-time existence check.

Then from the WFF stage in your Sequence job run two triggers - 'OK (Conditional)' which will fire when the file is found or an 'Otherwise' which will fire when it is not found. Do whatever is appropriate for each link - run the processing job, send an email, do nothing...

Oh, and Welcome Aboard! :D