Search found 38 matches

by sarjushah
Fri Apr 10, 2009 9:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multi valued Column in Hash File
Replies: 20
Views: 15743

I Created it using the hash file stage. But I did not see that option to make it multivalued, and I thought that was ok as per Ken's post , but he made a mentioned about later updating the dictionary. As you mentioned in your post about using the ED command for updating the dictionary, a sample woul...
by sarjushah
Thu Apr 09, 2009 2:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multi valued Column in Hash File
Replies: 20
Views: 15743

sarjushah wrote:I was successfully able to create a the hash file.

How do I create a dictionary entry to modify this hash file to be multivalued.

There were some sample in the forum for other changes to the dictionary but could not find any thing related to how to change a hash file multivalued
Anyone?
by sarjushah
Wed Apr 08, 2009 9:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Multi valued Column in Hash File
Replies: 20
Views: 15743

I was successfully able to create a the hash file.

How do I create a dictionary entry to modify this hash file to be multivalued.

There were some sample in the forum for other changes to the dictionary but could not find any thing related to how to change a hash file multivalued
by sarjushah
Tue Apr 07, 2009 11:02 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

Thanks chulett Here is the Final Solution. Hash File Combined Key (Colum1 + Column 2+ Column 3) Other Keys Column 4 and 5 The combined key is used for the Partial lookup defined a VOC entry SETFILE /opt/datastage/files/dev/polmc_lkp_new2 PolicyMChashLKP2 Created index CREATE.INDEX PolicyMChashLKP2 K...
by sarjushah
Mon Apr 06, 2009 2:02 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

It is currently a OCi query and went thru a series of tuning exercises and still pretty slow so now I want to try this and give it a shor. if this is also slow I might try the hash roll up thing described in one of Ken's posting. Do you know where I should put the require.index in my query ? SELECT ...
by sarjushah
Mon Apr 06, 2009 1:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

A dumb question , Where do it add it.?

I tried adding it before the ";" and it failed.

Do I need to put it after the select or something else.
by sarjushah
Mon Apr 06, 2009 10:57 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

I did the explain plan and below is the result. It is not using th index's . How can force it to use it.

The result is Access Method : File Scan

Do you have something like a oracle hint clause to make it use the index here
by sarjushah
Fri Apr 03, 2009 2:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

I created the index on the 3 columns that I am using as the key in my lookup using the odbc .(The hash file has a total of 5 columns defined as the key ) I excuted the following command to create and build the index CREATE.INDEX PolicyMChashLKPnEW LKP_POLMB_ID LKP_SBNT_KEY LKP_CVRPL_ID BUILD.INDEX P...
by sarjushah
Fri Apr 03, 2009 1:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

i did create the index.. but no speed
by sarjushah
Fri Apr 03, 2009 12:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Speed up a hash Lookup (Partial Key) created and build index
Replies: 13
Views: 8194

Speed up a hash Lookup (Partial Key) created and build index

File size 4.4 million records. total keys 5 Type 30 dynamic. Accessing via a ODBC connection to do a partial look key lookup using 3 keys . Multiple row lookup set to active. Read the forums and Created the index and build it for the 3 keys. Approx speed When hash file size is 100,000 rec --> 400row...
by sarjushah
Thu Apr 02, 2009 8:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Universe Query -
Replies: 23
Views: 7574

After posting this topic and the quick response I felt the premium was worth it.. So I am in. Paid my dues now waiting for my access to be granted .
by sarjushah
Thu Apr 02, 2009 2:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Universe Query -
Replies: 23
Views: 7574

Interesting... I guess there must be branded ODBC "Universe" drivers out there. I don't have any kind of DataStage access at the moment, so couldn't check what you might be using in the stage for this. Now I'm curious, does that fact help you at all? Solve your problem? :? No it doesnt.. ...
by sarjushah
Thu Apr 02, 2009 11:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Universe Query -
Replies: 23
Views: 7574

No, you can't - and I was wondering if that was why the question was being asked. Note that you use the UV stage, not the Universe stage, over the hashed file for this. ... I just tried and I am able to access the hash file using a ODBC stage. Using localuv and same VOC entry that I had created for...
by sarjushah
Thu Apr 02, 2009 8:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Universe Query -
Replies: 23
Views: 7574

chulett wrote:
sarjushah wrote:Let me search the forum but if you have it handy please pass it on.
It, what "it"? The link to Ken's post I already provided to you?
take it eazy
by sarjushah
Wed Apr 01, 2009 1:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Universe Query -
Replies: 23
Views: 7574

Huh? 200 million network + database queries is better than a hashed equi-join lookup with preloaded/cached data? Unless you think the PX Join is doing network lookups (sparse lookup) then I don't know what you're thinking. If Server is your only option, the best choice is to find a way to use a has...