I have one requiement for real time data integration, whenever data gets changed at source level need to load to datawarehouse. I need to implement it through data satge job which checks for data change at source and trigger a job which loads data to datawarehouse.Have to take care of latency also as data is in huge volume.
can anyone suggest pls
Thanks
Sudhir
Real time implementation of change data capture
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 11
- Joined: Fri Sep 05, 2008 4:20 am
- Location: chennai
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Don't use DataStage to do the checking - it can only be after the event. Use one of the newer technologies, such as Change Data Capture, which can feed the deltas into DataStage jobs.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.