Real time implementation of change data capture

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ksudhir466
Participant
Posts: 11
Joined: Fri Sep 05, 2008 4:20 am
Location: chennai

Real time implementation of change data capture

Post by ksudhir466 »

I have one requiement for real time data integration, whenever data gets changed at source level need to load to datawarehouse. I need to implement it through data satge job which checks for data change at source and trigger a job which loads data to datawarehouse.Have to take care of latency also as data is in huge volume.

can anyone suggest pls

Thanks
Sudhir
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Don't use DataStage to do the checking - it can only be after the event. Use one of the newer technologies, such as Change Data Capture, which can feed the deltas into DataStage jobs.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply