"will partition" warning

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Nsg
Premium Member
Premium Member
Posts: 37
Joined: Thu Jan 26, 2006 1:21 pm

"will partition" warning

Post by Nsg »

Hi all,

Is there a way to handle this warning - "Operator of type "APT_LUTCreateOp": will partition despite the
preserve-partitioning flag on the data set on input port 0."

This comes when there is a stage that has 2 outputs and 1 of it has sort / partition need. Why should it display this warning, since it is expicitly mentioned to sort / re-partition 1 link and not to for the 2nd link?

I donto know if setting the "preserve partitioning - clear"is the correct way to handle this, as this may cause the other link that need not be re-partitioned to be re-partitioned as well.

please help understand how will datastage handle this.

Thanks,
Nsg
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

APT_CreateOp is the operator that creates the virtual data set (the in-memory table) against which lookups will be performed, and builds an index for it unless the source is a Lookup File Set. APT_CreateOp is one of two operators in a composite operator created by virtue of the Lookup stage in the job design. Since it services a partitioned reference input link to the Lookup stage, it must effect that partitioning. Therefore it ignores any preserve partitioning setting, but warns you that it is doing so. This is a good example of where your knowledge of the underlying mechanism leads to the decision that it is safe to use a message handler to demote the severity of this message in the job log.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Nsg
Premium Member
Premium Member
Posts: 37
Joined: Thu Jan 26, 2006 1:21 pm

Post by Nsg »

Thanks, Ray.

as always you have a very clear and precise answer.
Post Reply