Hi
Could any one explain me how does a join stage work from conceptual perspective?
If i have some 10 million recs on each i/p how/where does the join stores that data in order to compare/find a match/How it make use of memory and buffer etc?
Please let know if you need more details...
How does a join stage work?
Moderators: chulett, rschirm, roy
How does a join stage work?
Manu
Datastage Devoloper
Datastage Devoloper
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The tsort operator requires sorted inputs. It loads the rows having first join key value from both inputs into memory and performs the join type based on that set of records (those with the first join key value). Any result is pushed onto the output link and the memory is freed. It then loads the rows having second join key value from both inputs into memory, and processes these. And so on until end-of-data is processed. By default 20MB of real memory per partition is allocated, so that scratch disk ought not to be needed.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.