Hash File Corrupted

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
satheesh_color
Participant
Posts: 182
Joined: Thu Jun 16, 2005 2:05 am

Hash File Corrupted

Post by satheesh_color »

Hi All,

Regularly we are building the hash file by using the job with the following command:CREATE.FILE HashFile DYNAMIC MINIMUM.MODULUS 150000 GROUP.SIZE 2 SEQ.NUM SPLIT.LOAD 80 MERGE.LOAD 50 LARGE.RECORD 4096.

Today the job was aborted and saying that "WriteHash() - Write failed for record id '1005971
514
07' "
We then try to rerun the same job it throws the following errors;
DSD.UVOpen "HashFile" is already in your VOC file as a file definition record.
File name =
File not created.

DataStage Job 55 Phantom 11597
Program "DSD.UVOpen": Line 456, WARNING: Internal file corruption detected during file open!
File must be repaired, possible truncation.
hsize: 4096
bsize: 4096
fsize: 553547776
Job Aborted after Fatal Error logged.


Please suggest me on how to resolve this issue..

Thanks & regards,
Satheesh
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

In the Hashed File stage you have create file checked, so click on the Options tab and also check "delete file before create".

This error arises from you (or somebody) not deleting the hashed file correctly. To fix the error you need to execute three commands from the Administrator client command window.

Code: Select all

DELETE VOC hashedfilename

SH -c "rm -rf hashedfilepath"

SH -c "rm -rf D_hashedfilepath"
And please note that the correct terminology is "hashed" file, not "hash" file.

Finally, it's normal practice to allow some leeway in LARGE.RECORD - it is usually set to or below 80% of the group buffer size. You have set it to 100% of the group buffer size which, while not illegal, is likely to be hugely sub-optimal.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
satheesh_color
Participant
Posts: 182
Joined: Thu Jun 16, 2005 2:05 am

Post by satheesh_color »

Thanks for you valuable information.

Satheesh.R
Post Reply