Search found 452 matches

by kaps
Fri Jul 27, 2007 7:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looking for some advice on Preload file to memory
Replies: 24
Views: 7674

How about if I have multiple reference lookup hashed files. In what order does it get loaded into memory ? For example... Hash1 Hash3 Hash5 | | | SeqFile--->Trn1------>Trn2---->Trn3---->SeqFile | | Hash2 Hash4 I am not able to get the picture right. Hash1 and Has2 lookedup from Trn1 and Hash3 and Ha...
by kaps
Thu Jul 26, 2007 3:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looking for some advice on Preload file to memory
Replies: 24
Views: 7674

I have not done anything yet. I am just trying to understand the process well before making changes. Another question. This may be basic. Anyway, How does the caching works in hashed files ? Meaning when I have multiple reference lookups in the process does the first hashed file gets loaded into mem...
by kaps
Thu Jul 26, 2007 1:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looking for some advice on Preload file to memory
Replies: 24
Views: 7674

Ray, Thanks for the info. I need some help here to make the changes to uvconfig file. Below are the current setting on uvconfig file... DISKCACHE -1 DCBLOCKSIZE 16 DCMODULUS 256 DCMAXPCT 80 DCFLUSHPCT 80 DCCATALOGPCT 50 1. If I set the DISKCACHE to 512 would that enough for system cache or public sh...
by kaps
Tue Jul 24, 2007 3:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looking for some advice on Preload file to memory
Replies: 24
Views: 7674

Thanks for the reply. I have another question here. In my process I do a lookup on same hashed file in three different transforms passing different values does that mean that It's going to load as many times memory ? In the first transform I have three reference lookups, second transform also has 3 ...
by kaps
Tue Jul 24, 2007 9:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looking for some advice on Preload file to memory
Replies: 24
Views: 7674

Ray Thanks for the info. But I am not getting this warning on that particular 1100 MB file rather I am getting it in different file. One other thing is we don't have the same problem in Production. How is it possible ? Do I miss something here ? I calculated the file size by adding data.30 file and ...
by kaps
Mon Jul 23, 2007 5:05 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Looking for some advice on Preload file to memory
Replies: 24
Views: 7674

Looking for some advice on Preload file to memory

Hi I am looking for some advice on Hashed file Preload file to memory option. I am getting the warning message as following...I know that this is just a warning message.But I am looking for a way to avoid this. "add_to_heap() - Unable to allocate memory" I am getting this warning for a Has...
by kaps
Fri Jun 08, 2007 9:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Internal Error: in DSCRestoreRowFromBuf
Replies: 1
Views: 607

Internal Error: in DSCRestoreRowFromBuf

Hi We got the following error. but when we reran it just ran fine. src_van_PolicyChanges_mrg..Sort_18: Error in merging files Internal Error: in DSCRestoreRowFromBuf Job Design is given below... SeqFile1 SeqFile2---->Link Collector---->Sort Stage---->AggregatorStage--->SeqFile SeqFile3 Sort Stage Ma...
by kaps
Fri May 04, 2007 11:24 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Running Multi Instance Job from Scheduler...
Replies: 5
Views: 2265

I am sorry for not making it clear in my first post. Let me try again... Setup is that DataStage jobs are run from Shell Script using a Third Party Scheduler. There is one common Shell Script which runs all the Jobs. Scenario is that I have a multi instance job to run. Problem is that the scheduler ...
by kaps
Fri May 04, 2007 8:32 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Running Multi Instance Job from Scheduler...
Replies: 5
Views: 2265

Am I not clear with the question ? I was expecting some ideas...
by kaps
Thu May 03, 2007 4:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Running Multi Instance Job from Scheduler...
Replies: 5
Views: 2265

Running Multi Instance Job from Scheduler...

I am facing a problem while running the multi instance job from the scheduler. Scheduler kicks off the DataStage Jobs using shell script. In this case, one instance of the Seq job is failed so it's not able to start the other instance. But If I put the RESET step in the script before running the job...
by kaps
Wed Apr 04, 2007 10:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Strange Behaviour of Jobs...
Replies: 2
Views: 1824

Strange Behaviour of Jobs...

Hi I am getting some strange errors with my DataStage job. We execute DS jobs from a third party scheduler using shell scripts. One day job completes without any issues but next day it gives error message like this "Job must be reset before it can run." I just reran the job it ran fine. On...
by kaps
Tue Mar 27, 2007 11:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Trying to find the Performance PRoblem...
Replies: 11
Views: 6265

Kenneth I am not sure if you can make sense out of this...I selected the code tag and pasted it but it comes like this...FYI...This is not the screenshot when I had problems. It's just sample...If the hdisk3 is 100% then my job is running slow...I believe that means there is high I/O. If that's corr...
by kaps
Tue Mar 27, 2007 10:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Trying to find the Performance PRoblem...
Replies: 11
Views: 6265

Can anyone tell me how can I paste a screen here ?

Thanks
by kaps
Thu Mar 22, 2007 6:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Trying to find the Performance PRoblem...
Replies: 11
Views: 6265

Yes. I do. I had them as my second option. I got more respect for you guys ! :D
by kaps
Thu Mar 22, 2007 5:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Trying to find the Performance PRoblem...
Replies: 11
Views: 6265

Trying to find the Performance PRoblem...

Hi I am trying to narrowdown the cause for one of my job which finishes quick in one day and takes long time on the other day. I did topas as my OS is AIX...I need some help in interpreting the results...I think we have 8 CPU's on the server. I see only less numbers in CPU% column but Disk busy colu...