Search found 17 matches

by rachelsu
Tue Apr 04, 2006 2:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Got it...thanks :)
by rachelsu
Mon Apr 03, 2006 7:17 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Thanks lots! I'll check it out. :)
by rachelsu
Mon Apr 03, 2006 6:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Again, thanks so much for your explanations! I learned a lot from your contributions to this thread :D It would appear that your system has 64BIT_FILES enabled in uvconfig; this is an inefficient setting, as it forces all hashed files, including the small ones in the Repository, to have 64-bit inter...
by rachelsu
Mon Apr 03, 2006 5:45 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

It sure has :P Thanks for your help!
by rachelsu
Mon Apr 03, 2006 2:07 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Magic!!! It worked! I'm now getting 13k rows/sec! That was indeed THE problem! :mrgreen: Thanks so much for your (ArndW, Ray, and Ross) wonderful help! Really appreciate it! If you happen to go pass Melb, let me know so I can buy you coffee or beer :) If you go to your ADMINistrator tool and execute...
by rachelsu
Mon Apr 03, 2006 1:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Thanks for the info! I only used DS for 1.5 weeks so far...How can I clear this file? I didn't create this file myself...suppose it was created by the transform procedures? If you don't need the unique key values generated thus far (i.e. you are in DEV and not PROD) then you can CLEAR.FILE this file...
by rachelsu
Mon Apr 03, 2006 1:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Here are the results... A quick test would involve the following commands, issues from the Administrator client Command window, or from the dssh environment on the server. COUNT SDKSequences 40310 records counted. FILE.STAT SDKSequences File type = 2 Number of groups in file (modulo) = 1 Separation ...
by rachelsu
Sun Apr 02, 2006 8:14 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

They look like the genuine routines - the only difference is that one hangs on to the lock (via WriteU) while the other releases it (Write). No indication why this might create slowness - most users have found this to be an adequately fast mechanism. Thanks for reviewing this! Now I'm really curiou...
by rachelsu
Sun Apr 02, 2006 6:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

This is the code I see in our dev repository... First sdk transform routine is called "KeyMgtGetNextValue", takes one argument.. ************************************************************************* * Copyright (C) 2003, 1997-2002 Ascential Software Corporation. All Rights Reserved. * ...
by rachelsu
Fri Mar 31, 2006 7:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Thanks very much for that! I'll check the routines we have here on Monday. Much appreciated!
by rachelsu
Fri Mar 31, 2006 1:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Can you email me your version? Or would you like me to email you my version? Pls advise. Thanks! Has some kind soul modified your KeyMgt routine? (There was one group of consultants running around Australia and New Zealand doing that for some years - rebadged the SDK routines as their own, and manag...
by rachelsu
Thu Mar 30, 2006 8:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

18 columns in total (approx 4-20 varchar for every column). Once I remove the KeyMgt transform, it runs at a few k rows/sec....hence my initial question about KeyMgt performance... 3 to 4 rows per second is not normal. I suspect something is wrong. From Sequential to Sequential without having any co...
by rachelsu
Thu Mar 30, 2006 6:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

I tried a simple server job SEQ FILE A --> TRANSFORM --> SEQ FILE B The TRANSFORM contains a direct map between A and B columns except the last numeric column is set to use KeyMgtGetNextValue('atest') instead of the input. The speed I'm getting is 3~4 rows/sec with a stop limit at 5k rows... Am I do...
by rachelsu
Wed Mar 29, 2006 10:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

:oops: I didn't go through it in detail. Thanks for the reminder!
by rachelsu
Wed Mar 29, 2006 10:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: keymgt slow performance?
Replies: 37
Views: 14040

Where did you read that? Can you provide the link here? :?: From what I've tested, I would say KeyMgt is much slower than @OUTROWNUM or DB key generation functions... [quote="balajisr"]Keymgt functions uses common blocks. I read that it is better to avoid common blocks. Does this also impl...