Invoking DS jobs real-time

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Invoking DS jobs real-time

Post by mydsworld »

I have a requirement where Datastage job needs to get fired whenever some files are generated in a remote system.The job needs to process those files as well.Please suggest the mechanism to do such polling & invoking DataStage job real-time.

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Remote system triggers job, dsjob or API. UNIX script polls for files and launches job. Looping Sequence job with Wait For File or scripted poll. All kinds of ways.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

For the remote system to trigger a DS job I think it requires to have some kind of remote shell invokation permission to run 'dsjob' command.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You'd need a user you could ssh to on the DataStage server, yes. Or something equivalent.
-craig

"You can never have too many knives" -- Logan Nine Fingers
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

Is there any other way of invoking a remote event based DataStage job
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

whats the best way of creating kind of 'always running' datastage job.I am using v8,is there any advanced feature to handle this.
mydsworld
Participant
Posts: 321
Joined: Thu Sep 07, 2006 3:55 am

Post by mydsworld »

whats the best way of creating kind of 'always running' datastage job.I am using v8,is there any advanced feature to handle this.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Use quality Stage.
Create a job to listen always to particular port, and process the incoming file to that port.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

WISD... formerly RTI, formerly SOA... you can expose a job as a web service.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply