Incremental Load

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
bond88
Participant
Posts: 109
Joined: Mon Oct 15, 2012 10:05 am
Location: USA

Incremental Load

Post by bond88 »

Hi,
I need to get the modified data from source. There is no timestamp at source but there is at target. I am comparing source and target's every column as key in Change Capture stage. But I am getting both previous and current values as two rows. I need only the latest one how can I achieve that?

Thanks,
Bhanu
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

The CDC Stage will give you the code for each of the two records to tell you which source it comes from and what the type of change is, using that you can decide which record to keep or to drop in a stage after the CDC.
bond88
Participant
Posts: 109
Joined: Mon Oct 15, 2012 10:05 am
Location: USA

Post by bond88 »

Thanks ArndW. I used filter stage to get the required row.
Bhanu
Post Reply