SCD - Sparse Lookup - DB2

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Raftsman
Premium Member
Premium Member
Posts: 335
Joined: Thu May 26, 2005 8:56 am
Location: Ottawa, Canada

SCD - Sparse Lookup - DB2

Post by Raftsman »

I received the following message when I switched the reference DB2 Connector from Normal to Sparse

main_program: Data set, file set, or file "TCRSTAT_OUT_ref:TCRSTAT_TEST_ref_lnk.v": Non-pipe (or non-virtual data set) with .v in its name
Data set, file set, or file "TCRSTAT_OUT_ref:TCRSTAT_TEST_ref_lnk.v": Non-pipe (or non-virtual data set) with .v in its name

We are dealing with large volumes and I assumed that this would be the optimal way for the SCD to function.

I read a few posts and one suggested, hash partitioning. I tried it and it didn't work.

Does Sparse Lookups work with the SCD stage.

Thanks
Jim Stewart
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No. The SCD stage needs to load the dimension table into memory.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply