Lookup Runs Slow

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
devidotcom
Participant
Posts: 247
Joined: Thu Apr 27, 2006 6:38 am
Location: Hyderabad

Lookup Runs Slow

Post by devidotcom »

Hi,

I have a simple job

Oracle Enterprise stage ---> modify stage --- >lookup with Oracle enterprise stage --->transformer--->oracle enterprise stage


The lookup runs really slow. The join is on one dummy value of 1 to fetch one value from the reference table. I can see the data tricle well till the modify stage. But the output of lookup stage is really slow. I have used entire partition on the reference link as we only have one record.

Please suggest what could be the problem with the code.

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Please clarify exactly what this is supposed to mean - "The join is on one dummy value of 1 to fetch one value from the reference table". Are you saying you are fetching the same (essentially) static value over and over from a database table? :?

Gory details and examples always appreciated.
-craig

"You can never have too many knives" -- Logan Nine Fingers
devidotcom
Participant
Posts: 247
Joined: Thu Apr 27, 2006 6:38 am
Location: Hyderabad

Post by devidotcom »

Yes.

For example:

Source Records
1 A B
1 A D
1 E P

One Reference Record only
1 PP

Output required
1 A B PP
1 A D PP
1 E P PP


The column with value 1 is the lookup key
devidotcom
Participant
Posts: 247
Joined: Thu Apr 27, 2006 6:38 am
Location: Hyderabad

Post by devidotcom »

Any help on this issue..
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

you mean to say that there will be only one record from reference link ?
what is the through put in primary link ?
Nag
devidotcom
Participant
Posts: 247
Joined: Thu Apr 27, 2006 6:38 am
Location: Hyderabad

Post by devidotcom »

yes only one record in the reference link and the primary link is the link from the source table.
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Is that a sparse lookup ?

If there is only one record, why don't you fetch that in a separate job and pass as parameters to current one ?
Post Reply