Page 1 of 1
Data getting added in CDC stage
Posted: Wed Feb 25, 2009 11:12 am
by Nagaraj
The Data from CDC stage is getting added each and everytime i run the job,
Note: I am just comparing the same datasets i.e same data.
The Key column i am using for cdc is a varchar column and i have trimmed on both the columns before doing cdc....not sure what else is missing. Yes also i have done Hash partitioning on the same key and sorted it remove dups if there are any.
Posted: Wed Feb 25, 2009 11:49 am
by Nagaraj
Any ideas any suggestions......?
Posted: Wed Feb 25, 2009 11:51 am
by chulett
Suggest... patience.
Posted: Wed Feb 25, 2009 11:51 am
by Nagaraj
Properties info..
1. Drop output for copy= True
2. And the rest all are set to FALSE.
Posted: Wed Feb 25, 2009 12:26 pm
by betterthanever
[quote="Nagaraj"]Properties info..
1. Drop output for copy= True
2. And the rest all are set to FALSE.[/quote]
please be more specific what do you mean by data getting added??
Posted: Wed Feb 25, 2009 1:03 pm
by Nagaraj
i have 100 records in before dataset and 100 records in after dataset and from CDC i am getting 200 records......
Note: both before and after datasets are same.
Posted: Wed Feb 25, 2009 1:22 pm
by girija
1. Check whether you have same number of columns in your before and after link.
2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not.
Posted: Wed Feb 25, 2009 1:24 pm
by girija
1. Check whether you have same number of columns in your before and after link.
2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not.
3. Check whether you are doing any kind of transformation before loading into your target table.
Posted: Wed Feb 25, 2009 1:25 pm
by girija
1. Check whether you have same number of columns in your before and after link.
2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not.
3. Check whether you are doing any kind of transformation before loading into your target table.
Posted: Wed Feb 25, 2009 1:43 pm
by Nagaraj
1. Check whether you have same number of columns in your before and after link. >>> Yes
2. Verify the key column and change columns, and see whether you add any surrogate or generated column in your before and after column list or not. >>> No there are no surrogate key.
3. Check whether you are doing any kind of transformation before loading into your target table. >> just plain inserts.
Posted: Wed Feb 25, 2009 1:53 pm
by girija
Just to check.
Take only one record to test and send it PEEK stage and compare each and every column. You might get a clue from that.
Best of luck.
Posted: Wed Feb 25, 2009 1:54 pm
by Nagaraj
Problem solved.....
One of the columns size was missing,.....
Thanks for your suggestions...