Hi,
I have used CDC a couple of times on dimension tables with low volume of data(about 1 million records) and the performance was good.But now I have a requirement where I have to compare an entire record(20 columns) and the volume of data is high(21 million records).The job is running for the last two hours.Does the CDC stage support such a high volume of data? Does the "minus" operation in Oracle prove to be more efficient.Please suggest!Thanks so much!
Note:The volume of data keeps on growing for every load
Regards,
Adi
CDC performance
Moderators: chulett, rschirm, roy
Minus is efficient but then again for a rather small dataset. How much is the byte size per row, that way you can calculate the amount of data you will be CDC'ing. Do test cases using both CDC stage and a simple minus function. Let us know your results.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.