Search found 452 matches
- Fri Jul 27, 2007 7:48 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Looking for some advice on Preload file to memory
- Replies: 24
- Views: 7674
How about if I have multiple reference lookup hashed files. In what order does it get loaded into memory ? For example... Hash1 Hash3 Hash5 | | | SeqFile--->Trn1------>Trn2---->Trn3---->SeqFile | | Hash2 Hash4 I am not able to get the picture right. Hash1 and Has2 lookedup from Trn1 and Hash3 and Ha...
- Thu Jul 26, 2007 3:52 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Looking for some advice on Preload file to memory
- Replies: 24
- Views: 7674
I have not done anything yet. I am just trying to understand the process well before making changes. Another question. This may be basic. Anyway, How does the caching works in hashed files ? Meaning when I have multiple reference lookups in the process does the first hashed file gets loaded into mem...
- Thu Jul 26, 2007 1:44 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Looking for some advice on Preload file to memory
- Replies: 24
- Views: 7674
Ray, Thanks for the info. I need some help here to make the changes to uvconfig file. Below are the current setting on uvconfig file... DISKCACHE -1 DCBLOCKSIZE 16 DCMODULUS 256 DCMAXPCT 80 DCFLUSHPCT 80 DCCATALOGPCT 50 1. If I set the DISKCACHE to 512 would that enough for system cache or public sh...
- Tue Jul 24, 2007 3:26 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Looking for some advice on Preload file to memory
- Replies: 24
- Views: 7674
Thanks for the reply. I have another question here. In my process I do a lookup on same hashed file in three different transforms passing different values does that mean that It's going to load as many times memory ? In the first transform I have three reference lookups, second transform also has 3 ...
- Tue Jul 24, 2007 9:30 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Looking for some advice on Preload file to memory
- Replies: 24
- Views: 7674
Ray Thanks for the info. But I am not getting this warning on that particular 1100 MB file rather I am getting it in different file. One other thing is we don't have the same problem in Production. How is it possible ? Do I miss something here ? I calculated the file size by adding data.30 file and ...
- Mon Jul 23, 2007 5:05 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Looking for some advice on Preload file to memory
- Replies: 24
- Views: 7674
Looking for some advice on Preload file to memory
Hi I am looking for some advice on Hashed file Preload file to memory option. I am getting the warning message as following...I know that this is just a warning message.But I am looking for a way to avoid this. "add_to_heap() - Unable to allocate memory" I am getting this warning for a Has...
- Fri Jun 08, 2007 9:25 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Internal Error: in DSCRestoreRowFromBuf
- Replies: 1
- Views: 607
Internal Error: in DSCRestoreRowFromBuf
Hi We got the following error. but when we reran it just ran fine. src_van_PolicyChanges_mrg..Sort_18: Error in merging files Internal Error: in DSCRestoreRowFromBuf Job Design is given below... SeqFile1 SeqFile2---->Link Collector---->Sort Stage---->AggregatorStage--->SeqFile SeqFile3 Sort Stage Ma...
- Fri May 04, 2007 11:24 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Running Multi Instance Job from Scheduler...
- Replies: 5
- Views: 2265
I am sorry for not making it clear in my first post. Let me try again... Setup is that DataStage jobs are run from Shell Script using a Third Party Scheduler. There is one common Shell Script which runs all the Jobs. Scenario is that I have a multi instance job to run. Problem is that the scheduler ...
- Fri May 04, 2007 8:32 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Running Multi Instance Job from Scheduler...
- Replies: 5
- Views: 2265
- Thu May 03, 2007 4:18 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Running Multi Instance Job from Scheduler...
- Replies: 5
- Views: 2265
Running Multi Instance Job from Scheduler...
I am facing a problem while running the multi instance job from the scheduler. Scheduler kicks off the DataStage Jobs using shell script. In this case, one instance of the Seq job is failed so it's not able to start the other instance. But If I put the RESET step in the script before running the job...
- Wed Apr 04, 2007 10:01 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Strange Behaviour of Jobs...
- Replies: 2
- Views: 1824
Strange Behaviour of Jobs...
Hi I am getting some strange errors with my DataStage job. We execute DS jobs from a third party scheduler using shell scripts. One day job completes without any issues but next day it gives error message like this "Job must be reset before it can run." I just reran the job it ran fine. On...
- Tue Mar 27, 2007 11:51 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Trying to find the Performance PRoblem...
- Replies: 11
- Views: 6265
Kenneth I am not sure if you can make sense out of this...I selected the code tag and pasted it but it comes like this...FYI...This is not the screenshot when I had problems. It's just sample...If the hdisk3 is 100% then my job is running slow...I believe that means there is high I/O. If that's corr...
- Tue Mar 27, 2007 10:40 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Trying to find the Performance PRoblem...
- Replies: 11
- Views: 6265
- Thu Mar 22, 2007 6:38 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Trying to find the Performance PRoblem...
- Replies: 11
- Views: 6265
- Thu Mar 22, 2007 5:35 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Trying to find the Performance PRoblem...
- Replies: 11
- Views: 6265
Trying to find the Performance PRoblem...
Hi I am trying to narrowdown the cause for one of my job which finishes quick in one day and takes long time on the other day. I did topas as my OS is AIX...I need some help in interpreting the results...I think we have 8 CPU's on the server. I see only less numbers in CPU% column but Disk busy colu...