Page 1 of 1

"will partition" warning

Posted: Wed Apr 11, 2012 2:48 pm
by Nsg
Hi all,

Is there a way to handle this warning - "Operator of type "APT_LUTCreateOp": will partition despite the
preserve-partitioning flag on the data set on input port 0."

This comes when there is a stage that has 2 outputs and 1 of it has sort / partition need. Why should it display this warning, since it is expicitly mentioned to sort / re-partition 1 link and not to for the 2nd link?

I donto know if setting the "preserve partitioning - clear"is the correct way to handle this, as this may cause the other link that need not be re-partitioned to be re-partitioned as well.

please help understand how will datastage handle this.

Thanks,
Nsg

Posted: Wed Apr 11, 2012 4:46 pm
by ray.wurlod
APT_CreateOp is the operator that creates the virtual data set (the in-memory table) against which lookups will be performed, and builds an index for it unless the source is a Lookup File Set. APT_CreateOp is one of two operators in a composite operator created by virtue of the Lookup stage in the job design. Since it services a partitioned reference input link to the Lookup stage, it must effect that partitioning. Therefore it ignores any preserve partitioning setting, but warns you that it is doing so. This is a good example of where your knowledge of the underlying mechanism leads to the decision that it is safe to use a message handler to demote the severity of this message in the job log.

Posted: Thu Apr 12, 2012 3:34 pm
by Nsg
Thanks, Ray.

as always you have a very clear and precise answer.