Round robin partition
Posted: Wed Jul 23, 2008 12:33 am
Hi,
I want to split the number of records equally in each partiton. So I have used Roun Robin partition in Transformer stage.
Job looks like
Dataset Datasets(3)
| | | |
| | | |
Dataset---join------Lookup-------Transformer-----Seq. File
I'm having 50 records in input.
In 2 node processing each node should get 25 records resp .
But in my job it is spliting into 24 and 26.
Why it is so...
Thanks!
Sasikala
I want to split the number of records equally in each partiton. So I have used Roun Robin partition in Transformer stage.
Job looks like
Dataset Datasets(3)
| | | |
| | | |
Dataset---join------Lookup-------Transformer-----Seq. File
I'm having 50 records in input.
In 2 node processing each node should get 25 records resp .
But in my job it is spliting into 24 and 26.
Why it is so...
Thanks!
Sasikala