4 nodes 10 stages

bhaggu · Post by **bhaggu** » Thu Apr 19, 2007 10:01 am

i have 4 nodes in my config file and 10 stages,so how many prosessors do i need?

Ultramundane · Post by **Ultramundane** » Thu Apr 19, 2007 10:39 am

mctny · Post by **mctny** » Thu Apr 19, 2007 1:29 pm

bhaggu wrote:i have 4 nodes in my config file and 10 stages,so how many prosessors do i need?

more than zero

DSguru2B · Post by **DSguru2B** » Thu Apr 19, 2007 1:36 pm

Are you both having fun with the poor guy

Bhaggu, what exactly do you want to know. A single processor is required for your stuff to execute. In px jobs, the number of processors is irrelevent per se. Its the number of nodes that decides how much parallelism will be incorporated.
Is this an interview question

?

mctny · Post by **mctny** » Thu Apr 19, 2007 2:07 pm

No no , not trying to have fun with him, but really the answer to his question is , any number of processors ( except zero) is fine.

I think ( it is just a guess), it is an interview question and what he is trying to ask is how many PROCESS will there be during the run time?

Is it what you are trying to ask?

ray.wurlod · Post by **ray.wurlod** » Thu Apr 19, 2007 3:24 pm

Zero processors is OK too. Comes under the heading of getting a life.

The number of nodes in the configuration file determines the degree of parallelism. At a simple level, each stage generates one operator (player process) per node, there is one section leader process per node, and there is one conductor process. With 10 stages, that comes to 45 processes. If they are all sufficiently lightweight, one CPU might be able to cope.

This simple explanation rarely holds, as several optimizations might take place, including operator combination (more than one operator in a single player process), composite operators (more than one operator for a single stage), removal of redundant operators, insertion of tsort and buffer operators.

csrazdan · Post by **csrazdan** » Mon Apr 23, 2007 1:53 pm

You will have -
Controller Process = 1 for the job
Section Leader = 1 per node = 4
Player = 1 per node per stage = 1*4*10 = 40

You will have total 45 processes for this job.

Hope it helps...

splayer · Post by **splayer** » Mon Apr 23, 2007 3:41 pm

csrazdan, I thought the Section Leader process is one of the 10 player processes? Is it not?

ray.wurlod · Post by **ray.wurlod** » Mon Apr 23, 2007 6:17 pm

It is not.

DSRajesh · Post by **DSRajesh** » Sat Jun 30, 2007 9:35 pm

Hi All

Can i know what are these section leaders and players etc...

ray.wurlod · Post by **ray.wurlod** » Sat Jun 30, 2007 11:41 pm

Yes.

And it's all in the manuals.

DSXchange

4 nodes 10 stages

4 nodes 10 stages

Re: 4 nodes 10 stages

Re: 4 nodes 10 stages