DS nodes vs partion

subrat · Post by **subrat** » Mon Jul 28, 2008 3:48 am

Hi,

Is number of nodes equals to number partition in DS. if both are same then how? Bit confused...

Thanks

ArndW · Post by **ArndW** » Mon Jul 28, 2008 4:11 am

The PX engine documentation uses "nodes" and "partitions" interchangeably to mean the same thing.

ray.wurlod · Post by **ray.wurlod** » Mon Jul 28, 2008 3:33 pm

Not quite. But they usually end up being the same.

A node is a processing unit - a set of processes at run time.

A partition is a subset of the data.

There are as many partitions as nodes. Be aware, however, that this can be different from the number of nodes in the configuration file, for example if a stage is constrained to executed in a node pool that does not include all of the nodes in the configuration file. In that case the number of partitions processed by that stage would be the number of nodes in that particular node pool.