Page 1 of 1

Error in PX JOB :cannot preserve the partitioning

Posted: Mon May 21, 2007 6:01 am
by ravibabu
Hi,

Please help me out from below warring.I am getting below warring when i am running a job in PX.

sff_Member_DAT: When checking operator: A sequential operator cannot preserve the partitioning
of the parallel data set on input port 0.

Posted: Mon May 21, 2007 6:31 am
by JoshGeorge
This happens when a parallel partitioning is collected to a sequential stage. In director add message handler to demote the warnings into info. "Suppress from log" :)

Posted: Mon May 21, 2007 6:33 am
by Maveric
You need to set the preserve partitioning property to clear in the stage before the stage that is giving this warning. This property tells the next stage to preserve the partitioning and if the next stage by default runs in sequential mode then it throws this warning.

Posted: Mon May 21, 2007 8:37 am
by keshav0307
you can not have partitioned Sequential file, so if your previous stage is also sequential then you will not get this warning, but if the previous stage is running parallel then You need to set the preserve partitioning property to clear in the Previous stage

Posted: Mon May 21, 2007 8:57 pm
by JoshGeorge
Consider 'clear partition' in the previous stage only if a sequential stage is your only target stage. If your records are further being forwarded to different stages which does parallel processing and is working on the previous partition, you can consider putting a copy stage before your sequential stage and do clear partition there. Suppressing from log stands a good option in other case.

You can see a good discussion here:

viewtopic.php?t=95035&highlight=clear+partition