Hi ,
I have a job where there are two input datasets which act as before and after dataset for a change capture stage.Output of the change capture stage is stored in a dataset.The two input links of change capture stage are sorted and hash partitioned on the key column.
The job is part of a sequence.The input datasets of the job is produced by two predecessor jobs called from the same sequence.When I am running the job through that sequence multiple times.in the job monitor the output link of the change capture stage is showing different counts in different runs,though the input records remains the same.
When I am running the same the job multiple times directly(not calling from sequence)the output record count is always the same for the change capture stage.
Can you please explain why the out put record count of the change capture stage is different for different runs when the job is called from sequence?
Thanks and Regards
Avik Dasgupta
Change capture stage producing conflicting output
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 42
- Joined: Fri Oct 20, 2006 1:58 am
Re: Change capture stage producing conflicting output
Hi Avik,
Are you sure that running through your sequence does not change the data selected in the two jobs predecessing your CDC-job?
Are you sure that running through your sequence does not change the data selected in the two jobs predecessing your CDC-job?
"It is not the lucky ones are grateful.
There are the grateful those are happy." Francis Bacon
There are the grateful those are happy." Francis Bacon
Re: Change capture stage producing conflicting output
Hi,
Please check if you are getting duplicates on the key columns. This behaviour of change capture stage is often observed when we get duplicates in the two source inputs.
Regards,
Praveen
Please check if you are getting duplicates on the key columns. This behaviour of change capture stage is often observed when we get duplicates in the two source inputs.
Regards,
Praveen
Guys, please stop quoting everything you are replying to. If you need to do it to make your point, that's fine, but don't just click on Reply with quote out of habit or because you think it's the only option. Use the Reply to topic link instead and save me the work of constantly having to clean up after you... which I'll do later.
Last edited by chulett on Fri Sep 30, 2011 10:47 am, edited 1 time in total.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: