Search found 237 matches

by myukassign
Fri Jun 11, 2010 12:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inline sort Storage
Replies: 2
Views: 1812

Inline sort Storage

Hi... I would like to get clarification about inline sorting. (The sort we apply on the input link of various stages where we have option of stable /unique sort). Where Datastage temporarily keep this data for inline sorting. Will it store the same place where the sort stage store (scratch disk) or ...
by myukassign
Fri Jun 11, 2010 12:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Yah, you've made this way more complicated than it needs to be. But what other option I have other than this. I tried everything that suggested in this thread but I did not get any improvement. But now its working as per my expection and everyone at my end is finally happy. They allowed me to close...
by myukassign
Wed Jun 09, 2010 5:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Alrt....I am getting very good speed now..... I did the following steps.....(I had no option) 1. I break the the jobs with 50 TRNS to smaller bits...like 10 each ds--> TRS-----> DS 2. I called the job like binary tree from sequencer..... It is designed in a way, at one time at the max two jobs will ...
by myukassign
Tue Jun 08, 2010 11:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Yes 90% of the complex elements are nested and can repeat any number of time and its cardinality is 0..N. I cant take multiple complex element in a transformer because The XML stage will let you assign only one column as key column. So incase If I try to fetch more than one complex element in one go...
by myukassign
Tue Jun 08, 2010 11:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

are you doing same kind of transformation processing on all 100 elements? if so, you might want to use one transformer job to do this processing on all the elements first at one go and then may be you can use a switch stage to send the output to different DS based on value of complex elements. No d...
by myukassign
Tue Jun 08, 2010 7:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Oki Let me explain you what I am trying to do.... 1. I have an input XML which has almost 100 complex elements. The idea is , source system send me all the related table information in each complex elements of that XML. 2. I need to move each complex element to 100 datasets with some small transform...
by myukassign
Tue Jun 08, 2010 5:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

It's all in the manual. You have to capture the perfomance data when you run the job, then the Performance Analyzer reports on the captured statistics. I tried with different combination of enabling and disabling operator but not much improvement in perfomance. 1. As I said before....The layout of ...
by myukassign
Tue Jun 08, 2010 1:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Is operator combination enabled or disabled? Use Monitor or Performance Analyzerto report on the CPU consumption. This will provide guidance about which sets of stages could benefit from disabling operator combination. When I start the perfomance analyzer it giveme warning window "No perfomanc...
by myukassign
Mon Jun 07, 2010 8:09 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ERROR CODE -14 ( PATCH)
Replies: 8
Views: 3696

How about... more than one? :wink: There's no way for anyone to answer that, too many variables in both the hardware and exactly what your Sequence and the jobs it runs do for a cogent answer. You have to do something like they did at Los Alamos when they tickled the dragon's tail - ramp things up ...
by myukassign
Mon Jun 07, 2010 7:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ERROR CODE -14 ( PATCH)
Replies: 8
Views: 3696

Grep for processes, something along the lines of: ps -ef |grep phantom | grep -v grep Should get you started. As to the general 'busy' question, work with your SysAdmin for that. One last clarification Craig.... How many jobs I can trigger simultaneously in a sequencer... It must be dependent on nu...
by myukassign
Mon Jun 07, 2010 6:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ERROR CODE -14 ( PATCH)
Replies: 8
Views: 3696

There is no 'exact' and not much to help to be given other than 'run fewer jobs at the same time'. Typically this means start rather than run as it is a startup issue. On a 'shared server' you'd have to do this at an enterprise level, working with the other teams to minimize the problem. How busy i...
by myukassign
Mon Jun 07, 2010 6:15 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ERROR CODE -14 ( PATCH)
Replies: 8
Views: 3696

Never found any need for a patch, this is easy enough to never trigger by proper job management. And by 'easy enough', I mean I never had to go out of my way or worry about this in any way in spite of typically needing to run many (many) hundreds of jobs daily. YMMV of course, but that's been my ex...
by myukassign
Mon Jun 07, 2010 1:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ERROR CODE -14 ( PATCH)
Replies: 8
Views: 3696

ERROR CODE -14 ( PATCH)

Hi, I did my homework by searching the dschange for code -14 error code. I realised the very common reason for this error is. A. Server overload. B. If a number of jobs triggering at the same time, and one of those jobs is not responding with in 60 seconds of turnaroud time. I saw the solutons as to...
by myukassign
Fri Jun 04, 2010 12:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Anything else you can tell us about the job and the source file? How many rows ends up taking the 15 minutes? Also, what happens if you just have "Source File ---- Transformer --- (some target), and then a Constraint in the Transformer that is impossible (such as 1=0)....or you could also just...
by myukassign
Fri Jun 04, 2010 12:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance with multiple transformers
Replies: 24
Views: 8244

Re: Improve performance with multiple transformers

NO File patters is thr in dataset so I did not use that.

Its a normal read.