Need help in understanding the OSH.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nikhilanshuman
Participant
Posts: 58
Joined: Tue Nov 17, 2009 3:38 am

Need help in understanding the OSH.

Post by nikhilanshuman »

Hi,
While reading the "Parallel job advenced user guide" , i came across following OSH :

##I TFSC 004000 14:51:50(000) <main_program>
This step has 1 dataset:
ds0: {op0[1p] (sequential generator)
eOther(APT_HashPartitioner { key={ value=a }
})->eCollectAny
op1[2p] (parallel APT_CombinedOperatorController:tsort)}
It has 2 operators:
op0[1p] {(sequential generator)
on nodes (
lemond.torrent.com[op0,p0]
)}
op1[2p] {(parallel APT_CombinedOperatorController:
(tsort)
(peek)
) on nodes (
lemond.torrent.com[op1,p0]
lemond.torrent.com[op1,p1]
)}
It runs 3 processes on 2 nodes.

I am unable to understand how the number of processes and the operators have been calculated here.Also,please explain what does "op1[2p],[op1,p0]" mean.
Nikhil
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

P0 and P1 are partitions 0 and 1, "OP" are operators. The confusions stems from a sequential operator that doesn't run on both nodes and operator combination of stages at runtime.
nikhilanshuman
Participant
Posts: 58
Joined: Tue Nov 17, 2009 3:38 am

Post by nikhilanshuman »

ArndW wrote:P0 and P1 are partitions 0 and 1, "OP" are operators. The confusions stems from a sequential operator that doesn't run on both nodes and operator combination of stages at runtime. ...
Thanks ArndW.Just one doubt is how the number of processes can be calculated from the given OSH?
Nikhil
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

2p + 1p = 3 processes as reported in the final line.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply