Search found 112 matches
- Thu Aug 23, 2007 8:34 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
Hi Arnd, What does Evenly spread key mean.My key columns are an ID like an SSN and a Coverage Type. I am having 2.4 million records of this combination here the ID would be a 22 byte number and coverage type would be a 2 byte number. Also the minimum modulus that i put was computed from one of the p...
- Thu Aug 23, 2007 6:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
RECORDS COUNTED
I am sorry I missed teh number of records counted.They are 2411941.
- Thu Aug 23, 2007 5:58 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
Hi, These are the following stats that i gathered with the help of Set File Command. FILETYPE : DYNAMIC HASHING ALGORITHM : GENERAL MODULUS : 678494 (I HAD SET THIS PARAMETER ) LARGE RECORD SIZE : 1628 GROUP SIZE : 4096 LOAD FACTORS : SPLIT(80%),ACTUAL(55%),MERGE(20%) (I HAD SET THIS PARAMETER ) TOT...
- Thu Aug 23, 2007 4:41 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
- Thu Aug 23, 2007 2:26 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
Exceeded 2GB limit
Hi All, I just ran into a another problem . My hash file size exceeded 2GB and I created a 64 bit hash file,now and its running slower than before. The following was the command I used to create /dsadm/Ascential/DataStage/DSEngine/bin/mkdbfile /dso/dsoweb/clients/jpmg/eligibility/logs/Hsh_PDSPersCov...
- Thu Aug 23, 2007 6:59 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
- Wed Aug 22, 2007 12:11 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
- Wed Aug 22, 2007 12:10 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
- Tue Aug 21, 2007 1:45 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
Hi , I am reading from a flat file and wirting it directly to a hash file. As teh file size reaches Seven hundred thousand I can see the write becoming really slow.Its like the First Seven hundred thousand rows get written in 8 mins and the remaining data out of a total 2.4 million takes 3 hours.I a...
- Mon Aug 20, 2007 2:50 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Hash File Performance Degrading ??
- Replies: 27
- Views: 9866
Hash File Performance Degrading ??
Hi All, I have a server job where in the data is ported from a sequential file to a hash file . The record count is 2.4 million. Though this is a straight move to the hash I see that some times the number of rows read per second starts with 3456 but gradually comes down to 335.I found this when I tr...
- Mon Aug 20, 2007 7:56 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Can you Call Pro C program from DataStage
- Replies: 1
- Views: 1052
Can you Call Pro C program from DataStage
Hi,
Can anyone let me know if it is possible to call a Pro C program from DataStage and if so how...
Can anyone let me know if it is possible to call a Pro C program from DataStage and if so how...
- Mon Aug 20, 2007 7:54 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Abnormal Termination Of IPC Stage
- Replies: 7
- Views: 2639
- Sun Aug 12, 2007 10:03 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Abnormal Termination Of IPC Stage
- Replies: 7
- Views: 2639
Hi Arnd, This is a hash file where record counts are written.Sorry this is not used as a look up,data is written into this file. When i run it without the IPC it works fine.I could also see the following error. From previous run DataStage Job 971 Phantom 19565 jobnotify: Unknown error jobnotify: Unk...
- Sun Aug 12, 2007 8:51 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Abnormal Termination Of IPC Stage
- Replies: 7
- Views: 2639
- Sun Aug 12, 2007 8:11 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Abnormal Termination Of IPC Stage
- Replies: 7
- Views: 2639
Abnormal Termination Of IPC Stage
Job Design is as follows ORA---> IPC----> Transform---along with 3 lookups---->finally --->Target(ORA) The following is the error i got Abnormal termination of stage EligPxiLoadFileExtractJob.12752.InterProcess_125.IDENT5 detected When i reset the job I got the below error EligPxiLoadFileExtractJob....