Page 1 of 1

configuration file

Posted: Mon Jan 15, 2007 6:52 pm
by vijaykumar
Hi,
My company is upgrading from server to parallel, can anyone help me in parallel edition , what is the theory behind assigning no of nodes to a process.

What i think is that if the no of nodes increases then load increases, so how can i determine the exact no of nodes required for a given process.

cheers;
vijay

Posted: Mon Jan 15, 2007 7:05 pm
by chulett
You forgot the 'regarding'. :wink:

Posted: Mon Jan 15, 2007 7:15 pm
by narasimha
There are many postings relating to this.
Try a search first.

Posted: Mon Jan 15, 2007 7:53 pm
by ray.wurlod
Each job requires one conductor process (on the "conductor node"), one section leader process per node and as many as one player process per stage per node. These are allocated automatically by the parallel engine.
Allocation as described may change due to operator combination and restriction of particular stages to execution in node pools. The former is automatic; the latter is a design decision. Operator combination may be prevented on a per-job or a per-stage basis.

Posted: Tue Jan 16, 2007 2:02 pm
by Saama
Hi Gurus,
Thanks Very much.

cheers;
saama

Posted: Tue Jan 16, 2007 2:22 pm
by I_Server_Whale
You can mark the topic as "Resolved".

Posted: Fri Feb 23, 2007 3:20 pm
by abc123
Ray, I have a few questions:

1)When we are talking about a "process", we are talking about a operating system process thread, right?
2)If you have a config file with 2 nodes and they look identical other than the name, how do you tell which one is a conductor process, which one is has the section leader and which has a player process?

Posted: Fri Feb 23, 2007 4:09 pm
by ray.wurlod
1. No. Just process. As a general rule DataStage does not use threads. (There are, of course, some exceptions, particularly in sorting.)

2. They both have section leader and player processes. The conductor node is usually the first-named node in the default node pool, unless you have specified APT_CONDUCTOR_NODE to place it elsewhere.

Posted: Fri Feb 23, 2007 4:54 pm
by abc123
If there is a configuration file where both nodes are on the same box, does it make a difference as to which one is the conductor?

Posted: Fri Feb 23, 2007 5:04 pm
by ray.wurlod
No.