Wait for File Activity

mystuff · Post by **mystuff** » Wed May 02, 2007 1:37 pm

Wait for File Activity can be used to wait for files to appear, is there any ADVISABLE time limit to use this stage.

i.e any under 4 hrs , we can use this stage or anything under 1 day etc..

DSguru2B · Post by **DSguru2B** » Wed May 02, 2007 1:42 pm

Thats completely upto you and how much time window is allowed for a file to appear by your requirements.

mystuff · Post by **mystuff** » Wed May 02, 2007 1:53 pm

I am using files to synchronize extracts from different clusters. If in case extract fails from any cluster and it take days to fix it, then we might be waiting for days. If everything goes well, then we might have to wait for 2-8 hrs.

Is it good to involve Enterprise scheduler for these scenarios (or) to use crontab (or) use wait for file activity

DSguru2B · Post by **DSguru2B** » Wed May 02, 2007 1:54 pm

Depends upon your inhouse standards. If there is an enterprise scheduler, go for it.

chulett · Post by **chulett** » Wed May 02, 2007 5:48 pm

Also depends on how often you want to perform the check. The DataStage job with the WFF stage will be running constantly over those days, checking for the file every 8 seconds from what I recall. It may be more appropriate to only check once a day or hour or some other configurable period.

Some people do that with the WFF stage set to wait 0 seconds to get a one-time check and then loop the job with the stage. Me, I'd probably do something at the 'Enterprise Scheduler' level and then have that call the processing job once it sees the file show up.