Error in PX JOB :cannot preserve the partitioning

ravibabu · Post by **ravibabu** » Mon May 21, 2007 6:01 am

Hi,

Please help me out from below warring.I am getting below warring when i am running a job in PX.

sff_Member_DAT: When checking operator: A sequential operator cannot preserve the partitioning
of the parallel data set on input port 0.

JoshGeorge · Post by **JoshGeorge** » Mon May 21, 2007 6:31 am

This happens when a parallel partitioning is collected to a sequential stage. In director add message handler to demote the warnings into info. "Suppress from log"

Maveric · Post by **Maveric** » Mon May 21, 2007 6:33 am

You need to set the preserve partitioning property to clear in the stage before the stage that is giving this warning. This property tells the next stage to preserve the partitioning and if the next stage by default runs in sequential mode then it throws this warning.

keshav0307 · Post by **keshav0307** » Mon May 21, 2007 8:37 am

you can not have partitioned Sequential file, so if your previous stage is also sequential then you will not get this warning, but if the previous stage is running parallel then You need to set the preserve partitioning property to clear in the Previous stage

JoshGeorge · Post by **JoshGeorge** » Mon May 21, 2007 8:57 pm

Consider 'clear partition' in the previous stage only if a sequential stage is your only target stage. If your records are further being forwarded to different stages which does parallel processing and is working on the previous partition, you can consider putting a copy stage before your sequential stage and do clear partition there. Suppressing from log stands a good option in other case.

You can see a good discussion here:

viewtopic.php?t=95035&highlight=clear+partition