configuration file
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 228
- Joined: Tue Oct 03, 2006 7:08 pm
configuration file
Hi,
My company is upgrading from server to parallel, can anyone help me in parallel edition , what is the theory behind assigning no of nodes to a process.
What i think is that if the no of nodes increases then load increases, so how can i determine the exact no of nodes required for a given process.
cheers;
vijay
My company is upgrading from server to parallel, can anyone help me in parallel edition , what is the theory behind assigning no of nodes to a process.
What i think is that if the no of nodes increases then load increases, so how can i determine the exact no of nodes required for a given process.
cheers;
vijay
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Each job requires one conductor process (on the "conductor node"), one section leader process per node and as many as one player process per stage per node. These are allocated automatically by the parallel engine.
Allocation as described may change due to operator combination and restriction of particular stages to execution in node pools. The former is automatic; the latter is a design decision. Operator combination may be prevented on a per-job or a per-stage basis.
Allocation as described may change due to operator combination and restriction of particular stages to execution in node pools. The former is automatic; the latter is a design decision. Operator combination may be prevented on a per-job or a per-stage basis.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 1255
- Joined: Wed Feb 02, 2005 11:54 am
- Location: United States of America
Ray, I have a few questions:
1)When we are talking about a "process", we are talking about a operating system process thread, right?
2)If you have a config file with 2 nodes and they look identical other than the name, how do you tell which one is a conductor process, which one is has the section leader and which has a player process?
1)When we are talking about a "process", we are talking about a operating system process thread, right?
2)If you have a config file with 2 nodes and they look identical other than the name, how do you tell which one is a conductor process, which one is has the section leader and which has a player process?
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
1. No. Just process. As a general rule DataStage does not use threads. (There are, of course, some exceptions, particularly in sorting.)
2. They both have section leader and player processes. The conductor node is usually the first-named node in the default node pool, unless you have specified APT_CONDUCTOR_NODE to place it elsewhere.
2. They both have section leader and player processes. The conductor node is usually the first-named node in the default node pool, unless you have specified APT_CONDUCTOR_NODE to place it elsewhere.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: