pipelining

dsuk · Post by **dsuk** » Thu Oct 23, 2008 12:53 am

could you tell me what are the parallel stages that supports pipeline parallelisim only.

Thanks in advance.

dsx999 · Post by **dsx999** » Thu Oct 23, 2008 1:05 am

To the best of my knowledge, except 'SORT' all the parallel stages support pipelining.

ray.wurlod · Post by **ray.wurlod** » Thu Oct 23, 2008 3:37 pm

In one sense no stage supports pipeline parallelism, because pipeline parallelism is between stages and is implemented using virtual Data Sets. In another sense every stage supports pipeline parallelism because a Data Set is the only input or output with which an Orchestrate operator can deal.