Slowly Changing Dimension stage with Type 2
Posted: Fri May 13, 2016 11:46 am
If I send 5 rows to a SCD stage with the same key for Type 2 determination, does it insert/update rows based on a certain criteria or does it do it at random?
For example, if I have data like this:
Business Type 2 Col
Key
12 X
12 A
12 Y
12 C
12 S
It sets the first 4 rows as not current and the final row inserted becomes current (not in the order I listed above). I tried doing a ORDER BY on the "Type 2 Col" before the data is sent to the Slowly Changing Dimension stage but it doesn't insert in that order. I would think that it would, considering that I am using a single node config file.
For example, if I have data like this:
Business Type 2 Col
Key
12 X
12 A
12 Y
12 C
12 S
It sets the first 4 rows as not current and the final row inserted becomes current (not in the order I listed above). I tried doing a ORDER BY on the "Type 2 Col" before the data is sent to the Slowly Changing Dimension stage but it doesn't insert in that order. I would think that it would, considering that I am using a single node config file.