spars vs normal lookup

ravi_etl · Post by **ravi_etl** » Wed May 13, 2009 9:56 am

Hi,

If you have huge data which lookup is a better option to choose.
spars or normal lookup and can you please explain me why.

Thanks

nagarjuna · Post by **nagarjuna** » Wed May 13, 2009 11:37 am

Huge data in what ? reference link or stream link ?

dsuser_cai · Post by **dsuser_cai** » Wed May 13, 2009 3:46 pm

If the source data is small and the reference data is too huge then you go with sparse look up (may be 10:100000), otherwise go with normal look up.

nagarjuna · Post by **nagarjuna** » Wed May 13, 2009 4:25 pm

Also ...Dont go with lookup with the reference data is too large to fit into memory .

chulett · Post by **chulett** » Wed May 13, 2009 8:31 pm

In other words, what it says in the documentation.