Hi,
Is there any way to estimate the max possible size of data that can be used as secondary link for Lookup Stage.
Thanks
Estimate Lookup Size
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Yes. The size of each data type is documented (from memory in Chapter 2 of the Parallel Job Developer's Guide). Add these together for all the columns in the row that you're processing, then multiply by the number of rows in the reference data set.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 97
- Joined: Tue Feb 21, 2006 6:45 am
Hi Ray,ray.wurlod wrote:Yes. The size of each data type is documented (from memory in Chapter 2 of the Parallel Job Developer's Guide). Add these together for all the columns in the row that you're processing, then ...
Sorry I didn't post my question properly.
After calculating the size, how can we determine whether Lookup might work without memory issues.
Thanks
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
How much memory do you have? How much scratchdisk in the nodes on which the Lookup stage operates? How many other stages are there in the job? How long is a piece of string? (Try it and see.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.