Performance gains by combining Lookups ???

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
tomengers
Participant
Posts: 167
Joined: Tue Nov 19, 2002 12:20 pm
Location: Key West

Performance gains by combining Lookups ???

Post by tomengers »

Hi Gang ...

I have a PX job with 3 Lookups - the reference file for each is a DataSet. Are there performance gains to be relized by combining these 3 Lookups into one Stage? ... or will the Optimizer do that for me?

thanks ...

... tom
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Re: Performance gains by combining Lookups ???

Post by priyadarshikunal »

tomengers wrote:Hi Gang ...

I have a PX job with 3 Lookups - the reference file for each is a DataSet. Are there performance gains to be relized by combining these 3 Lookups into one Stage? ... or will the Optimizer do that for me?

thanks ...

... tom
why dont you try both the options and let us know what the result is. :?

The DataStage optimizer combines the operators as much as possible.
not necessary that it will combine all the operators.

To know the difference try both option and let us know the timings and score.

Regards,
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If the Lookup (and any other) stages are adjacent, use the same degree of parallelism and combinable, then their operators will be combined into one process. Therefore the answer to you question is likely to be "no".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply