Change Capture clarification

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
laknar
Participant
Posts: 162
Joined: Thu Apr 26, 2007 5:59 am
Location: Chennai

Change Capture clarification

Post by laknar »

Hi,

We are doing delta capture.
first i am processing the record with 40000 records.

in existing table 40000 records have been loaded.
again i am loading the same 40000 records into same table.

its generating the new records into the file.
Regards
LakNar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You have not provided enough information (not have you asked a question). What is your job design and, in particular, what are you doing with, and with the results of, the change detection stage that you are using (and, for that matter, which stage type is it)?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
laknar
Participant
Posts: 162
Joined: Thu Apr 26, 2007 5:59 am
Location: Chennai

Post by laknar »

Hi,

source ----------- insert
|
Change_Capture---------File_generation
|
Exixting----------- Update


in insert delta indicator is 1 constraint
file indicator 1 and 3
update 2 and 3
Regards
LakNar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

(Please wrap your design in Code tags.)

I don't see any way you are testing the output of Change Capture to limit inserts and updates to detected new/changed records.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

Don't load data you have already loaded. Do delta filtering on the source (where clauses based on modify/creation dates) or use change data capture stage on the ETL layer or buy InfoSphere Change Data Capture for database log capture.
Post Reply