Page 1 of 1
APT_LUTCreateOp Warning(Preserve partition flag "Clear)
Posted: Tue Aug 25, 2009 3:50 pm
by dsedi
We are getting APT_LUTCreateOp warning message in one of our Job
Code: Select all
Lookup_70: When checking operator: Operator of type "APT_LUTCreateOp": will partition despite the
Preserve-partitioning flag on the data set on input port 0.
Lookup stage is having 2 reference Links with the main stream
Main stream from Oracle DB,
Reference 1 form DB2 stage
Reference 2 form a Transformer (which is getting data from a seq file stage)
We have enabled 3 columns as lookup keys and on all the 3 links, Partition Type set to Hash with Sorting Option Enabled
Prior to the Lookup, All the 3 stages Preserve partition flag has been set to Clear.
Before all slap down...we did search and read all which says about clearing the Preserve partition flag for this issue. and even we have replied something
here
Sorry If we are missing something and Thanks in advance for your help.
Posted: Tue Aug 25, 2009 4:03 pm
by ray.wurlod
So HAVE you set the Preserve Partitioning flag to "Clear" in the Lookup stage? In the stage upstream of the Lookup stage on each input?
Posted: Tue Aug 25, 2009 4:28 pm
by dsedi
ray.wurlod wrote:So HAVE you set the Preserve Partitioning flag to "Clear" in the Lookup stage? In the stage upstream of the Lookup stage on each input? ...
Ray Thanks.
Yes We have set the Preserve Partitioning flag to "Clear" in the Lookup stage and also in all the stages in the Job.
and fyi, we are getting this warning for both of the reference links
Code: Select all
Lookup_70: When checking operator: Operator of type "APT_LUTCreateOp": will partition despite the
preserve-partitioning flag on the data set on input port 0.
Lookup_70: When checking operator: Operator of type "APT_LUTCreateOp": will partition despite the
preserve-partitioning flag on the data set on input port 1.
Any clue would be appreciated. Thanks in advance
Posted: Tue Aug 25, 2009 10:24 pm
by ray.wurlod
Check again that you have done this, particularly on the inputs to the Lookup stage. If you have, check that you have subsequently re-compiled the job.
Posted: Wed Aug 26, 2009 9:13 am
by dsedi
ray.wurlod wrote:Check again that you have done this, particularly on the inputs to the Lookup stage. If you have, check that you have subsequently re-compiled the job. ...
Thanks Ray. Yes, we are sure we have done this (Changing the Preserve partition flag to clear in all the input stages - before the lookup stage.)
and compiled couple of times for running again and again!
Does anybody have this kind of experience before? Does it need any patch level fix?
Thanks in advance.
Re: APT_LUTCreateOp Warning(Preserve partition flag "Cl
Posted: Tue Sep 15, 2009 10:20 am
by lamyyy
I encounter the same warning when I change partitioning to hash in reference link. The work around I used is to set it back to auto and add copy stage before the reference link and apply hash or remove duplicate before the ref link.
Re: APT_LUTCreateOp Warning(Preserve partition flag "Cl
Posted: Tue Sep 15, 2009 11:41 am
by dsedi
lamyyy wrote:I encounter the same warning when I change partitioning to hash in reference link. The work around I used is to set it back to auto and add copy stage before the reference link and apply hash or remove duplicate before the ref link.
Thanks lamyyy!
Yes you are right. We were getting this warning while we had the partition type as "Hash" on the reference Links. Now we have them as Entire and they are fine(no warnings)
You mean to say that, adding a copy stage before the lookup stage and keep the hash partition on the lookup stage reference input link will work without warnings? we will try this and post the results here.
Thanks again and we appreciate that.