Hi Guys,
In join stage, i am aware that the parallel engine will insert a tsort operator to do the sort operation, which in turn requires temp space in scratch disk to store the temporary files. If i dont do the sort operation by giving "dont sort environmental variable", temp space wont be required. How does the join based on the key happens here. It uses the temp space to do the join operation or it do in "on-fly" during database access. If yes, does join requires less temp space than sort. Please explain this scenario.
Thanks in advance.
Join stage
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The Join stage will not produce correct results, or may run out of memory, if the data are not sorted. If you prevent insertion of a tsort operator (without providing your own sorting on the input links), your job is likely to abort.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
No, no and no.
The join stage is performing it's work in memory, which is why it can run out of memory as Ray mentioned. It doesn't use scratch space, temp space or database space.
Buffers on the input links may use scratch or temp space on your servers.
Regards,
The join stage is performing it's work in memory, which is why it can run out of memory as Ray mentioned. It doesn't use scratch space, temp space or database space.
Buffers on the input links may use scratch or temp space on your servers.
Regards,
- james wiles
All generalizations are false, including this one - Mark Twain.
All generalizations are false, including this one - Mark Twain.
-
- Participant
- Posts: 30
- Joined: Sat Dec 19, 2009 5:19 am
- Location: Manchester, UK