Search found 112 matches

by Vinodanand
Thu Aug 23, 2007 8:34 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hi Arnd, What does Evenly spread key mean.My key columns are an ID like an SSN and a Coverage Type. I am having 2.4 million records of this combination here the ID would be a 22 byte number and coverage type would be a 2 byte number. Also the minimum modulus that i put was computed from one of the p...
by Vinodanand
Thu Aug 23, 2007 6:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

RECORDS COUNTED

I am sorry I missed teh number of records counted.They are 2411941.
by Vinodanand
Thu Aug 23, 2007 5:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hi, These are the following stats that i gathered with the help of Set File Command. FILETYPE : DYNAMIC HASHING ALGORITHM : GENERAL MODULUS : 678494 (I HAD SET THIS PARAMETER ) LARGE RECORD SIZE : 1628 GROUP SIZE : 4096 LOAD FACTORS : SPLIT(80%),ACTUAL(55%),MERGE(20%) (I HAD SET THIS PARAMETER ) TOT...
by Vinodanand
Thu Aug 23, 2007 4:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hi Arnd, I get the following error when I keyed in the command . COUNT Hsh_PDSPersCovgPrevHist_coal_13058 syntax error . unexpected sentence without file name.Token was "".Scanned Command was COUNT 'Hsh_PDSPersCovgPrevHist_coal_13058' and for command ANALYZE.FILE Hsh_PDSPersCovgPrevHist_co...
by Vinodanand
Thu Aug 23, 2007 2:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Exceeded 2GB limit

Hi All, I just ran into a another problem . My hash file size exceeded 2GB and I created a 64 bit hash file,now and its running slower than before. The following was the command I used to create /dsadm/Ascential/DataStage/DSEngine/bin/mkdbfile /dso/dsoweb/clients/jpmg/eligibility/logs/Hsh_PDSPersCov...
by Vinodanand
Thu Aug 23, 2007 6:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hi Arnd,

When I keyed in the command "ANALYZE.FILE {Hsh_PDSPersCovgPrevHist_coal_13058}" in DS Administrator I got the following error.

Verb "ANALYZE.FILE" is not in your VOC.

Regards,
Vinod
by Vinodanand
Wed Aug 22, 2007 12:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

I missed out on this.I am using T30 Dynamic Hash file with default settings.Also is there a way I can the HFC.exe as I found it in one of teh posts but the link was invalid.

Thanks,
Vinod
by Vinodanand
Wed Aug 22, 2007 12:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hi Arnd,

I tried using the COUNT{filename} command in the Administrator was it threw a syntax error.Also how would i be able to check teh minimum modulus of teh file after it has run.

Regards,
Vinod
by Vinodanand
Tue Aug 21, 2007 1:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hi , I am reading from a flat file and wirting it directly to a hash file. As teh file size reaches Seven hundred thousand I can see the write becoming really slow.Its like the First Seven hundred thousand rows get written in 8 mins and the remaining data out of a total 2.4 million takes 3 hours.I a...
by Vinodanand
Mon Aug 20, 2007 2:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash File Performance Degrading ??
Replies: 27
Views: 9866

Hash File Performance Degrading ??

Hi All, I have a server job where in the data is ported from a sequential file to a hash file . The record count is 2.4 million. Though this is a straight move to the hash I see that some times the number of rows read per second starts with 3456 but gradually comes down to 335.I found this when I tr...
by Vinodanand
Mon Aug 20, 2007 7:56 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can you Call Pro C program from DataStage
Replies: 1
Views: 1052

Can you Call Pro C program from DataStage

Hi,

Can anyone let me know if it is possible to call a Pro C program from DataStage and if so how...
by Vinodanand
Mon Aug 20, 2007 7:54 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal Termination Of IPC Stage
Replies: 7
Views: 2639

Hi ,


The issue has been resolved. The /tmp directory was at 100% and hence the IPC stages were abnormally terminated. I cleared teh same and ran the job and they went through fine.

Thanks all for your help.

Regards,
Vinod
by Vinodanand
Sun Aug 12, 2007 10:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal Termination Of IPC Stage
Replies: 7
Views: 2639

Hi Arnd, This is a hash file where record counts are written.Sorry this is not used as a look up,data is written into this file. When i run it without the IPC it works fine.I could also see the following error. From previous run DataStage Job 971 Phantom 19565 jobnotify: Unknown error jobnotify: Unk...
by Vinodanand
Sun Aug 12, 2007 8:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal Termination Of IPC Stage
Replies: 7
Views: 2639

I also see the following error

Fault type is 10. Layer type is BASIC run machine.

Fault occurred in BASIC program DSD.IPCOpen at address 8c0.


Please let me know what could be the cause of this issue.
by Vinodanand
Sun Aug 12, 2007 8:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal Termination Of IPC Stage
Replies: 7
Views: 2639

Abnormal Termination Of IPC Stage

Job Design is as follows ORA---> IPC----> Transform---along with 3 lookups---->finally --->Target(ORA) The following is the error i got Abnormal termination of stage EligPxiLoadFileExtractJob.12752.InterProcess_125.IDENT5 detected When i reset the job I got the below error EligPxiLoadFileExtractJob....