Search found 6 matches

by nachos
Mon Nov 21, 2005 10:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: increase performance
Replies: 7
Views: 3423

Arnd,

The sort operator, just as is, runs at about 1000 r/s which is a lot slower than writing to the hash file with cache 16,000 r/s and subsequently reading from the hash was about 4000 r/s.

Kenneth,

Great new approches to try re. multiple jobs.


Thanks to Ken, Arnd, Naveen for your replies.
by nachos
Sun Nov 20, 2005 11:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: increase performance
Replies: 7
Views: 3423

Naveen,

I have used the HFC and sized the hash file appropriately, tried cache on/off, tried mofying the hash file parameters but all of these did not contribute much.

Nach
by nachos
Sun Nov 20, 2005 10:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: increase performance
Replies: 7
Views: 3423

increase performance

Hi. I am trying to increase the performance of a job and have run out of ideas to try. Hoping that anyone of you might a suggestion. Details: Have a datafile with about 10m rows. The key is, Identifier number and occurrence number. That is there can be multiple occurrences for any given Identifier n...
by nachos
Wed Oct 26, 2005 6:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: slow startup of administrator
Replies: 1
Views: 1084

slow startup of administrator

When I startup the adminstrator is takes over 2 minutes for the window to appear. When I startup the designer and choose the dev project the response is a few second but when I choose the TEST project it takes a few minutes. It's definitely project specific. The only thing that we do different on th...
by nachos
Tue Sep 27, 2005 5:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: writing variable length records
Replies: 2
Views: 1507

writing variable length records

Hi. In my input text file I get five record types A-F. Each record type has a diff length. To read this file I have specifed the field as char(2000) string and used a delimter which does not occur. When I apply a filter in the transform ( say only records for state of NY ) and write the result to a ...
by nachos
Tue Sep 06, 2005 6:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: constraint performane
Replies: 1
Views: 1064

constraint performane

Hi. I have a record of 2000 bytes, positions 1,2 are the sourceType and positions 55,56 are the accountType. In my first job I am trying to split the record by source and account by specifying constraints like inputRecord[1,2] = "23" The first stage for sourceType has good performance of 2...