handling lookup data
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 236
- Joined: Sun Apr 01, 2007 7:41 am
- Location: Michigan
handling lookup data
i have a question. A lookup stage in parallel edition can accomodate how much amount of data. becuase i want to differentiate between a join and a lookup. i heard for less data we use lookups and for huge datas we use join stage. so i want to know till what amount of memory(in bytes) i can user a lookup
It is not absolute. It depends upon your available memory, lookup source type, speed, performance expections, levels of parallelism and other factors.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Premium Member
- Posts: 236
- Joined: Sun Apr 01, 2007 7:41 am
- Location: Michigan
handling lookup data
in our case we are running on two nodes and each node has a memory on 1 MB. with this info can i get the answer i require
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 236
- Joined: Sun Apr 01, 2007 7:41 am
- Location: Michigan
handling lookup data
ray.wurlod wrote:With 1MB of memory you're not even going to have an operating system, much less DataStage. Please check your figures.
i am sorry each node carries 1 GB of memory
A "node" is a PX/EE term and you cannot directly associate memory to it.
Do you mean you have a 2-CPU system with a total of 2Gb main memory?
Do you mean you have a 2-CPU system with a total of 2Gb main memory?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>