Page 1 of 1
handling lookup data
Posted: Sat Nov 03, 2007 8:06 pm
by just4u_sharath
i have a question. A lookup stage in parallel edition can accomodate how much amount of data. becuase i want to differentiate between a join and a lookup. i heard for less data we use lookups and for huge datas we use join stage. so i want to know till what amount of memory(in bytes) i can user a lookup
Posted: Sat Nov 03, 2007 8:20 pm
by ArndW
It is not absolute. It depends upon your available memory, lookup source type, speed, performance expections, levels of parallelism and other factors.
handling lookup data
Posted: Sat Nov 03, 2007 9:08 pm
by just4u_sharath
in our case we are running on two nodes and each node has a memory on 1 MB. with this info can i get the answer i require
Posted: Sat Nov 03, 2007 10:38 pm
by ray.wurlod
With 1MB of memory you're not even going to have an operating system, much less DataStage. Please check your figures.
handling lookup data
Posted: Sat Nov 03, 2007 11:24 pm
by just4u_sharath
ray.wurlod wrote:With 1MB of memory you're not even going to have an operating system, much less DataStage. Please check your figures.
i am sorry each node carries 1 GB of memory
Posted: Sun Nov 04, 2007 12:50 am
by ArndW
A "node" is a PX/EE term and you cannot directly associate memory to it.
Do you mean you have a 2-CPU system with a total of 2Gb main memory?