what is Sparse lookup and what is Normal look up

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
HariD
Participant
Posts: 15
Joined: Tue Feb 23, 2010 3:14 am
Location: Chennai
Contact:

what is Sparse lookup and what is Normal look up

Post by HariD »

what is Sparse lookup and what is Normal look up
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Moderator: please move to Enterprise Edition (Parallel) forum

These are not Server Edition concepts.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
nikhilanshuman
Participant
Posts: 58
Joined: Tue Nov 17, 2009 3:38 am

Post by nikhilanshuman »

Sparse Lookup : This method is preferred when the rato from source data and reference data is 1:1000.I mean when the source records are very less than the reference records,the Sparce lookup is used.In this way of lookup,for each source record,a query is fired to get the reference data.

Normal Lookup: In Normal Lookup,the entire reference data is loaded into memory first(lookup stage).
Nikhil
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

In addition, a sparse lookup, since it is executed for each row as it is read, is also used to read the current value from the source, unlike the normal lookup which has an image of the value from the time it was loaded at the start of the job run.
Post Reply