Always running DS job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Always running DS job

Post by mydsworld »

If a DS job (sequence) is created with 'Wait for File' activity stage timeout set to 'Do not timeout', then isn't that a 'always running' job until it finds a file.In such case is it going to affect the system performance.
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

No, and you can easily measure job system impact using prstat, topas, glance, top, or any other monitoring tool. The wait-for-file API can be read about in the DS BASIC manual.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Yes, it will run until it finds a file or dies. There shouldn't be any hit to much other than your filesystem, which will be polled every... four seconds(?), I believe, for the file.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

Which one is better option in terms of performance :

1. Polling through Cron and calling a DS job
2. Using 'Wait for File' activity to poll.

Thanks.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Option 2 will use less resources for the same polling period.
Post Reply