Page 1 of 1

Change Capture clarification

Posted: Sun Dec 07, 2008 11:19 pm
by laknar
Hi,

We are doing delta capture.
first i am processing the record with 40000 records.

in existing table 40000 records have been loaded.
again i am loading the same 40000 records into same table.

its generating the new records into the file.

Posted: Sun Dec 07, 2008 11:50 pm
by ray.wurlod
You have not provided enough information (not have you asked a question). What is your job design and, in particular, what are you doing with, and with the results of, the change detection stage that you are using (and, for that matter, which stage type is it)?

Posted: Sun Dec 07, 2008 11:54 pm
by laknar
Hi,

source ----------- insert
|
Change_Capture---------File_generation
|
Exixting----------- Update


in insert delta indicator is 1 constraint
file indicator 1 and 3
update 2 and 3

Posted: Mon Dec 08, 2008 3:54 pm
by ray.wurlod
(Please wrap your design in Code tags.)

I don't see any way you are testing the output of Change Capture to limit inserts and updates to detected new/changed records.

Posted: Wed Dec 10, 2008 3:53 am
by vmcburney
Don't load data you have already loaded. Do delta filtering on the source (where clauses based on modify/creation dates) or use change data capture stage on the ETL layer or buy InfoSphere Change Data Capture for database log capture.