Page 1 of 1

CDC performance

Posted: Fri Mar 20, 2009 1:08 pm
by adis
Hi,
I have used CDC a couple of times on dimension tables with low volume of data(about 1 million records) and the performance was good.But now I have a requirement where I have to compare an entire record(20 columns) and the volume of data is high(21 million records).The job is running for the last two hours.Does the CDC stage support such a high volume of data? Does the "minus" operation in Oracle prove to be more efficient.Please suggest!Thanks so much!

Note:The volume of data keeps on growing for every load

Regards,
Adi

Posted: Fri Mar 20, 2009 1:37 pm
by DSguru2B
Minus is efficient but then again for a rather small dataset. How much is the byte size per row, that way you can calculate the amount of data you will be CDC'ing. Do test cases using both CDC stage and a simple minus function. Let us know your results.