Data getting added in CDC stage

Nagaraj · Post by **Nagaraj** » Wed Feb 25, 2009 11:12 am

The Data from CDC stage is getting added each and everytime i run the job,

Note: I am just comparing the same datasets i.e same data.

The Key column i am using for cdc is a varchar column and i have trimmed on both the columns before doing cdc....not sure what else is missing. Yes also i have done Hash partitioning on the same key and sorted it remove dups if there are any.

Nagaraj · Post by **Nagaraj** » Wed Feb 25, 2009 11:49 am

Any ideas any suggestions......?

chulett · Post by **chulett** » Wed Feb 25, 2009 11:51 am

Suggest... patience.

Nagaraj · Post by **Nagaraj** » Wed Feb 25, 2009 11:51 am

Properties info..

1. Drop output for copy= True
2. And the rest all are set to FALSE.

betterthanever · Post by **betterthanever** » Wed Feb 25, 2009 12:26 pm

[quote="Nagaraj"]Properties info..

1. Drop output for copy= True
2. And the rest all are set to FALSE.[/quote]

please be more specific what do you mean by data getting added??

Nagaraj · Post by **Nagaraj** » Wed Feb 25, 2009 1:03 pm

i have 100 records in before dataset and 100 records in after dataset and from CDC i am getting 200 records......

Note: both before and after datasets are same.

girija · Post by **girija** » Wed Feb 25, 2009 1:22 pm

1. Check whether you have same number of columns in your before and after link.

2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not.

girija · Post by **girija** » Wed Feb 25, 2009 1:24 pm

1. Check whether you have same number of columns in your before and after link.

2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not.

3. Check whether you are doing any kind of transformation before loading into your target table.

girija · Post by **girija** » Wed Feb 25, 2009 1:25 pm

1. Check whether you have same number of columns in your before and after link.

2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not.

3. Check whether you are doing any kind of transformation before loading into your target table.

Nagaraj · Post by **Nagaraj** » Wed Feb 25, 2009 1:43 pm

1. Check whether you have same number of columns in your before and after link. >>> Yes

2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not. >>> No there are no surrogate key.

3. Check whether you are doing any kind of transformation before loading into your target table. >> just plain inserts.

girija · Post by **girija** » Wed Feb 25, 2009 1:53 pm

Just to check.

Take only one record to test and send it PEEK stage and compare each and every column. You might get a clue from that.

Best of luck.

Nagaraj · Post by **Nagaraj** » Wed Feb 25, 2009 1:54 pm

Problem solved.....

One of the columns size was missing,.....

Thanks for your suggestions...