Difference between Join and Lookup

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
prasad v
Participant
Posts: 174
Joined: Mon Mar 30, 2009 2:18 am

Difference between Join and Lookup

Post by prasad v »

Hi

I wanted to know the when can we use the JOINER AND LOOKUP.

I am new to DS. I am studying the Pdf's .

What is understood is if reference link haveing more data we should go to Joiner.

My doubt is that if we use in-memory method in Lookup then only it takes the whole data to server memory and lookup's the input link. If we use Sparse method, it doesn't take the whole data to server memory.
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

thts correct ...for more information you can search the forum ..
Nag
Sreenivasulu
Premium Member
Premium Member
Posts: 892
Joined: Thu Oct 16, 2003 5:18 am

Post by Sreenivasulu »

Join , Lookup and merge have lot of similarities.

Regards
Sreeni
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

... but very important subtle differences.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sajidkp
Participant
Posts: 114
Joined: Thu Apr 30, 2009 12:17 am
Location: New Delhi

Post by sajidkp »

1.join will take only one partition data of master (reference table) at a time in memory where as lookup (sparse) take all the data in to memmory

2. We can have reject link in lookup . not possible in joiner

3.joiner is good if data volume is huge.
Regards,
Sajid KP
jonyfranc
Premium Member
Premium Member
Posts: 9
Joined: Fri Feb 06, 2009 6:32 pm

Post by jonyfranc »

The Join, Lookup and Merge stages combine two or more input links according to values of key columns. They differ mainly in memory usage, treatment of rows with unmatched key values and input requirements i.e. sorted and de-duped

Francis
Post Reply