Page 1 of 1

Round robin partition

Posted: Wed Jul 23, 2008 12:33 am
by vcsasikala
Hi,
I want to split the number of records equally in each partiton. So I have used Roun Robin partition in Transformer stage.

Job looks like


Dataset Datasets(3)
| | | |
| | | |
Dataset---join------Lookup-------Transformer-----Seq. File


I'm having 50 records in input.

In 2 node processing each node should get 25 records resp .
But in my job it is spliting into 24 and 26.

Why it is so...


Thanks!
Sasikala

Posted: Wed Jul 23, 2008 1:26 am
by ray.wurlod
Because there is a minimum quantum of data that DataStage moves at a time. 24/26 is close enough to evenly spread.

For what it's worth, Round Robin is almost certainly completely wrong for your Join and Lookup stages.