6MB in Reference Data: OK for Lookup Or go for a JOIN

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vijayrc
Participant
Posts: 197
Joined: Sun Apr 02, 2006 10:31 am
Location: NJ

6MB in Reference Data: OK for Lookup Or go for a JOIN

Post by vijayrc »

Hi,
I'm evaluating a job for optimization/performance etc, and I see that there's a JOIN being used. One of the reference file can be upto 6MB. Is it advisable to go for LOOKUP in place of this JOIN ?
Thanks
Top
ds_debasis
Participant
Posts: 17
Joined: Fri May 25, 2007 11:59 am

Re: 6MB in Reference Data: OK for Lookup Or go for a JOIN

Post by ds_debasis »

vijayrc wrote:Hi,
I'm evaluating a job for optimization/performance etc, and I see that there's a JOIN being used. One of the reference file can be upto 6MB. Is it advisable to go for LOOKUP in place of this JOIN ?
Thanks
I think using Lookup stage ( with ref. link entire partitioning and input link unsorted) will enhance the performance.
Top
Post Reply

Return to “IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)”