DSXchange

Small Question
Why we have to entire partition the reference data on Lookup stage?
because we are loading the whole reference data into memory and what is the need to use entire partitioning. When we are getting whole data into memory, do we still need partitioning on reference link. When we entire partition the reference link on a 4 node system, single copy of data is brought to memory and 4 nodes creates their own pointers to memory. In look up stage where did this nodes come from. (i understand look stage is Physical ram). please help

This is really the same question as the one in this post which was also posted by you today.

ray.wurlod wrote:This is really the same question as the one in this post which was also posted by you today.

Sorry abt that double copy.