Change capture stage producing conflicting output
Posted: Fri Sep 30, 2011 12:16 am
Hi ,
I have a job where there are two input datasets which act as before and after dataset for a change capture stage.Output of the change capture stage is stored in a dataset.The two input links of change capture stage are sorted and hash partitioned on the key column.
The job is part of a sequence.The input datasets of the job is produced by two predecessor jobs called from the same sequence.When I am running the job through that sequence multiple times.in the job monitor the output link of the change capture stage is showing different counts in different runs,though the input records remains the same.
When I am running the same the job multiple times directly(not calling from sequence)the output record count is always the same for the change capture stage.
Can you please explain why the out put record count of the change capture stage is different for different runs when the job is called from sequence?
Thanks and Regards
Avik Dasgupta
I have a job where there are two input datasets which act as before and after dataset for a change capture stage.Output of the change capture stage is stored in a dataset.The two input links of change capture stage are sorted and hash partitioned on the key column.
The job is part of a sequence.The input datasets of the job is produced by two predecessor jobs called from the same sequence.When I am running the job through that sequence multiple times.in the job monitor the output link of the change capture stage is showing different counts in different runs,though the input records remains the same.
When I am running the same the job multiple times directly(not calling from sequence)the output record count is always the same for the change capture stage.
Can you please explain why the out put record count of the change capture stage is different for different runs when the job is called from sequence?
Thanks and Regards
Avik Dasgupta