Hi,
We are doing delta capture.
first i am processing the record with 40000 records.
in existing table 40000 records have been loaded.
again i am loading the same 40000 records into same table.
its generating the new records into the file.
Change Capture clarification
Moderators: chulett, rschirm, roy
Change Capture clarification
Regards
LakNar
LakNar
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You have not provided enough information (not have you asked a question). What is your job design and, in particular, what are you doing with, and with the results of, the change detection stage that you are using (and, for that matter, which stage type is it)?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
(Please wrap your design in Code tags.)
I don't see any way you are testing the output of Change Capture to limit inserts and updates to detected new/changed records.
I don't see any way you are testing the output of Change Capture to limit inserts and updates to detected new/changed records.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
Don't load data you have already loaded. Do delta filtering on the source (where clauses based on modify/creation dates) or use change data capture stage on the ETL layer or buy InfoSphere Change Data Capture for database log capture.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn