how many process will create
Moderators: chulett, rschirm, roy
how many process will create
if am runing a job on three node and having 3 stages then how many process will create
thanks & regards
kk
kk
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
how we can say as 13 process,can u explain me
ray.wurlod wrote:Thirteen.
Unless there is operator combination or some other optimization happening. ...
if i am having stages like
dataset---->transformer---->targetdatabase.
and running on three node.
can u tell me where we can get this information.plz
thanks & regards
kk
kk
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The simplest model is where there is no operator combination. Each operator (for simplicity) represents one stage. You have three stages, therefore three operators, on each of three processing nodes. That makes for a total of nine "player" processes executing the operators. Each processing node has a "section leader" process looking after co-ordination on that particular node, and there is one "conductor" process (the startup process) managing overall co-ordination and logging.
Nine player processes, three section leader processes and one conductor process equals a total of thirteen processes.
Nine player processes, three section leader processes and one conductor process equals a total of thirteen processes.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.