Sparse look up usage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
LavanyaRamesh007
Participant
Posts: 42
Joined: Mon Apr 21, 2008 1:49 am

Sparse look up usage

Post by LavanyaRamesh007 »

Since the reference data is too big I am planning to use Sparse look up.. Before that should i have to confirm this by checking the RAM size???
Is it that only when RAM is too small to fit reference data we got to go for Sparse look up...??
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No, you can use sparse lookup at any time, whether or not you have checked the memory. It is the least efficient option, and is intended for use only when the reference data set is known in advance to be too large to fit in virtual memory. Note that sparse lookup can not be selected dynamically, so forget any idea you may have had about checking memory at run time within DataStage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply