Sequential file partition

srini.dw · Post by **srini.dw** » Wed Jul 24, 2013 8:22 am

Hi,

Got a question from DS exam.

You have a job that reads in sequential file followed by transformer stage. When you run this job, which partitioning method will be used by default?

The answer is Round Robin.

Any idea why.

Thanks,

ArndW · Post by **ArndW** » Wed Jul 24, 2013 8:48 am

Because that is the way that they designed it. The round robin algorithm requires no knowledge of the data or column contents and effectively distributes the data across all parallel nodes.

srini.dw · Post by **srini.dw** » Wed Jul 24, 2013 8:52 am

Thank you.

ray.wurlod · Post by **ray.wurlod** » Wed Jul 24, 2013 4:50 pm

This thread (final post) explains what (Auto) uses.