Page 1 of 1

Query on SCD Stage

Posted: Fri Sep 13, 2013 7:10 am
by balu536
Hi,
I've a query on Slow Changing Dimensions (SCD) Stage.

Do we need to sort the data (on the input links) on the Business Keys being used in the stage?
Is it mandatory for proper functioning of SCD stage, like we do for Join and Merge stages?


Thanks.

Posted: Fri Sep 13, 2013 5:30 pm
by ray.wurlod
Data do not need to be sorted on business key. When the dimension table is loaded into memory the business key column is identified. That is sufficient.

Posted: Thu Sep 19, 2013 3:10 pm
by balu536
Thanks Ray.

Also is it fine if we do partitioning (Hash) on the source link alone or is it required on both source and reference link?

Please clarify.

Posted: Fri Sep 20, 2013 8:00 am
by asorrell
Yes, the partitioning should match on both links. However, if the other link is set to "auto" then DataStage will determine that it needs to be set to match the other input stream and set it to "Hash" on the right keys without tell you. I believe if you look at the osh you can verify that.

However, I always recommend setting stages explicitly so it is more evident where the partitioning is occurring.

Posted: Fri Sep 20, 2013 8:02 am
by asorrell
Yes and No. Yes, the partitioning should match on both links. However, if the other link is set to "auto" then DataStage will determine that it needs to be set to match the other input stream and set it to "Hash" on the right keys without tell you. I believe if you look at the osh you can verify that.

However, I always recommend setting stages explicitly so it is more evident where the partitioning is occurring.

Posted: Fri Sep 20, 2013 11:35 am
by balu536
Thanks Andy. :)