Database polling in PX

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sanjeev_sithara
Participant
Posts: 15
Joined: Wed May 26, 2004 6:30 am

Database polling in PX

Post by sanjeev_sithara »

How can I perform polling of a particular Oracle table continuously in PX 7.5 to find out any Inserts/Updates?
rasi
Participant
Posts: 464
Joined: Fri Oct 25, 2002 1:33 am
Location: Australia, Sydney

Post by rasi »

Have a control table to store the maximum/last keys or dates of the oracle table you want to poll. Then schedule a separate job to read the control table and find is there any changes happen to the oracle table. If it does then you can start you other downstream jobs and finally update the control table with the maximum/last keys for the next poll.

Cheers
Regards
Siva

Listening to the Learned

"The most precious wealth is the wealth acquired by the ear Indeed, of all wealth that wealth is the crown." - Thirukural By Thiruvalluvar
sanjeev_sithara
Participant
Posts: 15
Joined: Wed May 26, 2004 6:30 am

Post by sanjeev_sithara »

Hi Siva,

Thank You for you r reply.
The polling interval in my case is about 20 secs as specified by the client.
Suppose , I execute another job which writes to a file based on the polling result, will it create a dead lock situation since too many processes try to write to the same file (as the time interval is so small, many instances of the job can be running at the same time)?
pnchowdary
Participant
Posts: 232
Joined: Sat May 07, 2005 2:49 pm
Location: USA

Post by pnchowdary »

Hi Sanjeev,

Since the time interval for polling is 20 seconds. I feel that it can be best achieved at the database level using techniques like Triggers etc.
Thanks,
Naveen
Post Reply