lookup with the target!!

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
suryadev
Premium Member
Premium Member
Posts: 211
Joined: Sun Jul 11, 2010 7:39 pm

lookup with the target!!

Post by suryadev »

I have a requirement to look up with the target as it gets loaded.
i.e the records should get loaded in the target and then this should
act as reference to the source to pull the key from target to update an other field in target.

Now the job gets loaded with the empty field as their is no look up with the target.

please provide any input for this requirement.

Thanks
Thanks,
Surya
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You seem to have stated the requirement quite well. I am presuming, of course, that your mapping specification correctly identifies the lookup key(s).

What you don't seem to have done is thought through the rule to be followed when the lookup does not succeed and when the lookup succeeds.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
suryadev
Premium Member
Premium Member
Posts: 211
Joined: Sun Jul 11, 2010 7:39 pm

Post by suryadev »

Thank you

so do you mean do the lookup where it suceeds?

actually this is a kind of dynamic lookup.

The target needs to be loaded with an extra field which comes when we do lookup with the target itself.

So records should be loaded and also look up has to be done as they get loaded and the records which succeed look up should be loaded.
Thanks,
Surya
suryadev
Premium Member
Premium Member
Posts: 211
Joined: Sun Jul 11, 2010 7:39 pm

Post by suryadev »

Is dynamic look up possible in data stage 7.5 parallel jobs?

Made a search but could not find a scenario where dynamic look up is done in parallel jobs of 7.5 version.

please suggest any design to implement that in a parallel job?


Thank you
Thanks,
Surya
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What do you mean by "dynamic"?

If you want the previous row to be available then you must set transaction size and array size to 1.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
suryadev
Premium Member
Premium Member
Posts: 211
Joined: Sun Jul 11, 2010 7:39 pm

Post by suryadev »

What I mean by dynamic is a row should be inserted and then lookup with the source so that the primary key assigned to the inserted row is used as a parentkey to other records.
so that the table gets updated with the parentkey for all the records in the hierarchyexcept the top level.

I set array size to 1 in the oracle enterprise stage and also environmental variable
ORA_UPSERT_COMMITROWINTERVAL TO 1 but still the records are not
loaded with the parentkey.


Thank you
Thanks,
Surya
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

What kind of a lookup are you doing - sparse?
-craig

"You can never have too many knives" -- Logan Nine Fingers
suryadev
Premium Member
Premium Member
Posts: 211
Joined: Sun Jul 11, 2010 7:39 pm

Post by suryadev »

Yes I am using sparse look up for which the parentkey
gets '0' in all the records.

and when I use normal look up the parentkey field is empty.

Second time I ran the same job with an other update link then all the records were updated with the right parent key.

Thank you
Thanks,
Surya
Post Reply