Our company is getting version 8 very soon, and is considering implement type 2 SCD using SCD stage. I have read SCD stage use in-memory lookup. If we have a monster-type SCD type 2, (I have talking about potentially hundreds of millions rows with at least dozens of type-2 columns), is SCD stage still a valid choice?
Has anyone used SCD stage for large volume dimension table? What happens when total dataset size is larger than physically available memory?
Thanks
LM
Performance concern for SCD stage for very large dimension
Moderators: chulett, rschirm, roy
I don't have a problem using CDC or SK. My question is that if the new SDC stage is rigorous enough for us to throw some heavy stuff at it. The new SCD stage centainly looks very interesting, and will make coding and maintenance much easier.richdhan wrote:Hi,
Search the forum for CDC topics. That should give you more information on how to handle SCDs as well as to generate SKs.
HTH
--Rich
If we don't have a high confidence that it won't choke on large volumn, then we have to maintain 2 code bases until we test it out during later stage of development cycle. That will make life a little more interesting for us.
LM