Defining SCD Type at the record level

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
itcconsulting
Premium Member
Premium Member
Posts: 26
Joined: Tue May 24, 2005 6:20 am
Location: Tallahassee

Defining SCD Type at the record level

Post by itcconsulting »

I'm in the process of finalizing a dimension loading process following Kimball's methodology. I have a question that may change my process. What's the affect of treating the whole record as Type 1 or Type 2 instead of individual columns on a record?
Byron
diamondabhi
Premium Member
Premium Member
Posts: 108
Joined: Sat Feb 05, 2005 6:52 pm
Location: US

Post by diamondabhi »

Welcome itcconsulting,
I think thats how it should be, can you be more specific with ur problem.

Thanks,
Abhi
itcconsulting
Premium Member
Premium Member
Posts: 26
Joined: Tue May 24, 2005 6:20 am
Location: Tallahassee

Post by itcconsulting »

If my dimension table contains 4 non key attributes and one (or two) of those attributes require Type 2 SCD response, could I just treat any changed row as Type 2?
Byron
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Yes. W.r.t. that one col.
itcconsulting
Premium Member
Premium Member
Posts: 26
Joined: Tue May 24, 2005 6:20 am
Location: Tallahassee

Post by itcconsulting »

What's the downside of treating any change as a Type 2 regardless of the column?
Byron
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

You need to include complex conditions and more development time.

You landup with performance head-ache and development back-ache.

Again, everything depends upon your business requirement, analysis and design.
itcconsulting
Premium Member
Premium Member
Posts: 26
Joined: Tue May 24, 2005 6:20 am
Location: Tallahassee

Post by itcconsulting »

In speaking with the business community, I found that there is a business requirement to define the SCD Type at the field level. Could someone provided some advice on the DataStage logic needed make the field level SCD decision within my server job?
Byron
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Search this forum for more details.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The DataStage logic is exactly the same as the "logical logic". If a field is a candidate for recording change, then a new record must be created whenever there is a change in that field. Therefore, you must determine whether a change has occurred. This involves being able to see (pre-load) what's already current in the target table, and to test for change in every candidate field.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply