Page 1 of 1

how to avoid this warning

Posted: Wed Oct 18, 2006 5:34 pm
by bollinenik
Hi,

I am using sort stage in my job with transformers, So ia m getting one warning for all seq.files in jobs, totally i am using 3 seq files as target i am getting warning like "Dup_Error_File_FF: When checking operator: A sequential operator cannot preserve the partitioning
of the parallel data set on input port 0." pls tell me how to avoid this
Thanks in Advance

Posted: Wed Oct 18, 2006 6:43 pm
by ray.wurlod
Stop asking the Sequential File (or some other stage operating in Sequential mode) to preserve partitioning (maybe implicitly via Auto). Perhaps specify an explicit Collection algorithm.

Re: how to avoid this warning

Posted: Mon Oct 23, 2006 12:47 am
by Chuah
bollinenik wrote:Hi,

I am using sort stage in my job with transformers, So ia m getting one warning for all seq.files in jobs, totally i am using 3 seq files as target i am getting warning like "Dup_Error_File_FF: When checking operator: A sequential operator cannot preserve the partitioning
of the parallel data set on input port 0." pls tell me how to avoid this
Thanks in Advance
Hi,
Try writing out to Data Sets as opposed to Seq files if that is possible that way you can get around the issue.

Chin

Posted: Mon Oct 23, 2006 2:54 am
by Nageshsunkoji
Hi,

If your requirement is to keep the data in a sequential file then change the Preserve Partitioning option from defualt(Propogate) to Clear in the Advanced tab of stage before sequential file.