can i see what this "APT_CombinedOperatorController&quo

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
zulfi123786
Premium Member
Premium Member
Posts: 730
Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore

can i see what this "APT_CombinedOperatorController&quo

Post by zulfi123786 »

Hi,
when i use the APT_RECORD_COUNTS environment variable it shows this operator "APT_CombinedOperatorController" consuming a lot of cpu.
Is it possible for me to know what this combined operator is doing???
miwinter
Participant
Posts: 396
Joined: Thu Jun 22, 2006 7:00 am
Location: England, UK

Post by miwinter »

Yes, you need to dump out the score and verify what this combined operator involves. This is all advanced stuff though which you should really attend the vendor course for to gain an appreciation. It is also covered in the documentation,as most things are.
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

My guess is that you have an example of over-enthusiastic operator combination occurring. This will always be the case with operator combination - it is as aggressive as it can be under the rules for combining operators (the operators must be adjacent and share the same degree of parallelism on the same set of nodes).

To ameliorate this situation, selectively make one or more of the stages non-combinable. To find out which ones, disable operator combination totally and monitor the job to determine the resource consumption. Then combine such that demand for resources is not excessive from any of your new combinations of operators, once operator combination has been re-enabled.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply