Arnd,
The sort operator, just as is, runs at about 1000 r/s which is a lot slower than writing to the hash file with cache 16,000 r/s and subsequently reading from the hash was about 4000 r/s.
Kenneth,
Great new approches to try re. multiple jobs.
Thanks to Ken, Arnd, Naveen for your replies.
Search found 6 matches
- Mon Nov 21, 2005 10:27 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: increase performance
- Replies: 7
- Views: 3423
- Sun Nov 20, 2005 11:20 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: increase performance
- Replies: 7
- Views: 3423
- Sun Nov 20, 2005 10:34 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: increase performance
- Replies: 7
- Views: 3423
increase performance
Hi. I am trying to increase the performance of a job and have run out of ideas to try. Hoping that anyone of you might a suggestion. Details: Have a datafile with about 10m rows. The key is, Identifier number and occurrence number. That is there can be multiple occurrences for any given Identifier n...
- Wed Oct 26, 2005 6:36 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: slow startup of administrator
- Replies: 1
- Views: 1084
slow startup of administrator
When I startup the adminstrator is takes over 2 minutes for the window to appear. When I startup the designer and choose the dev project the response is a few second but when I choose the TEST project it takes a few minutes. It's definitely project specific. The only thing that we do different on th...
- Tue Sep 27, 2005 5:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: writing variable length records
- Replies: 2
- Views: 1507
writing variable length records
Hi. In my input text file I get five record types A-F. Each record type has a diff length. To read this file I have specifed the field as char(2000) string and used a delimter which does not occur. When I apply a filter in the transform ( say only records for state of NY ) and write the result to a ...
- Tue Sep 06, 2005 6:25 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: constraint performane
- Replies: 1
- Views: 1064
constraint performane
Hi. I have a record of 2000 bytes, positions 1,2 are the sourceType and positions 55,56 are the accountType. In my first job I am trying to split the record by source and account by specifying constraints like inputRecord[1,2] = "23" The first stage for sourceType has good performance of 2...