Wait for File Activity can be used to wait for files to appear, is there any ADVISABLE time limit to use this stage.
i.e any under 4 hrs , we can use this stage or anything under 1 day etc..
Wait for File Activity
Moderators: chulett, rschirm, roy
I am using files to synchronize extracts from different clusters. If in case extract fails from any cluster and it take days to fix it, then we might be waiting for days. If everything goes well, then we might have to wait for 2-8 hrs.
Is it good to involve Enterprise scheduler for these scenarios (or) to use crontab (or) use wait for file activity
Is it good to involve Enterprise scheduler for these scenarios (or) to use crontab (or) use wait for file activity
Also depends on how often you want to perform the check. The DataStage job with the WFF stage will be running constantly over those days, checking for the file every 8 seconds from what I recall. It may be more appropriate to only check once a day or hour or some other configurable period.
Some people do that with the WFF stage set to wait 0 seconds to get a one-time check and then loop the job with the stage. Me, I'd probably do something at the 'Enterprise Scheduler' level and then have that call the processing job once it sees the file show up.
Some people do that with the WFF stage set to wait 0 seconds to get a one-time check and then loop the job with the stage. Me, I'd probably do something at the 'Enterprise Scheduler' level and then have that call the processing job once it sees the file show up.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers