configuration file

vijaykumar · Post by **vijaykumar** » Mon Jan 15, 2007 6:52 pm

Hi,
My company is upgrading from server to parallel, can anyone help me in parallel edition , what is the theory behind assigning no of nodes to a process.

What i think is that if the no of nodes increases then load increases, so how can i determine the exact no of nodes required for a given process.

cheers;
vijay

chulett · Post by **chulett** » Mon Jan 15, 2007 7:05 pm

You forgot the 'regarding'.

narasimha · Post by **narasimha** » Mon Jan 15, 2007 7:15 pm

There are many postings relating to this.
Try a search first.

ray.wurlod · Post by **ray.wurlod** » Mon Jan 15, 2007 7:53 pm

Each job requires one conductor process (on the "conductor node"), one section leader process per node and as many as one player process per stage per node. These are allocated automatically by the parallel engine.
Allocation as described may change due to operator combination and restriction of particular stages to execution in node pools. The former is automatic; the latter is a design decision. Operator combination may be prevented on a per-job or a per-stage basis.

Saama · Post by **Saama** » Tue Jan 16, 2007 2:02 pm

Hi Gurus,
Thanks Very much.

cheers;
saama

I_Server_Whale · Post by **I_Server_Whale** » Tue Jan 16, 2007 2:22 pm

You can mark the topic as "Resolved".

abc123 · Post by **abc123** » Fri Feb 23, 2007 3:20 pm

Ray, I have a few questions:

1)When we are talking about a "process", we are talking about a operating system process thread, right?
2)If you have a config file with 2 nodes and they look identical other than the name, how do you tell which one is a conductor process, which one is has the section leader and which has a player process?

ray.wurlod · Post by **ray.wurlod** » Fri Feb 23, 2007 4:09 pm

1. No. Just process. As a general rule DataStage does not use threads. (There are, of course, some exceptions, particularly in sorting.)

2. They both have section leader and player processes. The conductor node is usually the first-named node in the default node pool, unless you have specified APT_CONDUCTOR_NODE to place it elsewhere.

abc123 · Post by **abc123** » Fri Feb 23, 2007 4:54 pm

If there is a configuration file where both nodes are on the same box, does it make a difference as to which one is the conductor?

ray.wurlod · Post by **ray.wurlod** » Fri Feb 23, 2007 5:04 pm