Change Data Capture issue.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Shadab_Farooque
Participant
Posts: 21
Joined: Tue Apr 24, 2007 12:39 am

Change Data Capture issue.

Post by Shadab_Farooque »

I am using Change Data Capture Stage.

I am comparing 2 Oracle table having 6 million records each.Both the Tables are identical.
2nd table is the copy of 1st table.

I have not done any changes in the tables.However,I am getting 20,000 records as changed/updated.When actually there are no changes.

Partitioning is set to auto in Change Data Capture Stage.And I am sorting the incoming Data(Asc) through SORT Stage.

Please help how to get rid of the above error
Shadab Farooque
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

Is the metadata for before and after datasets in change capture stage same?
JoshGeorge
Participant
Posts: 612
Joined: Thu May 03, 2007 4:59 am
Location: Melbourne

Post by JoshGeorge »

Change Data Capture (CDC) needs more care to be given. Reading the relevant help document is the first step.

Also make sure:

:arrow: In the input tab of your Change Capture stage you have used the same partition on the same partition keys. Also your sorting keys are the same and in the same order.
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

How many nodes are you running this on?

And, have you tried taking one record from the output and comparing all columns in the two input columns for that record?

This may help you find the problem.......
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
Post Reply