combined oparators

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
agpt
Participant
Posts: 151
Joined: Sun May 16, 2010 12:53 am

combined oparators

Post by agpt »

Hi All,

can anybody tell me what are combined operators. Normally they are being disabled using APT_DISABLE_COMBINATION. What exactly it does is not by disabling the combined operators.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Operator combination is the decision made at run time, when the score is being composed, to execute multiple adjacent operators that share the same parallelism and partitioning specifications into one process rather than using a separate process for each operator. The combined operator is called APT_CombinedOperatorController and the score will reveal the operators that have been combined.

Despite the generally laudable goal of reducing total processes, operator combination is as aggressive as possible, which can lead to too few processes or, to put it another way, too much resource demand in a single process. Every stage, therefore, can be made not combinable through its properties.

The other "problem" for operator combination is that all errors and warnings are reported as being from APT_CombinedOperatorController, so you don't get information about which operator actually threw the error. Therefore, while diagnosing, disabling operator combination is usually a valuable technique.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
myukassign
Premium Member
Premium Member
Posts: 238
Joined: Fri Jul 25, 2008 8:55 am

Post by myukassign »

It's very very very useful information...... Mainly debugging help you mentioned....

Thanks....
Post Reply