How to resolve "Can't open DS_JOBOBJECTS" error

sathishmca · Post by **sathishmca** » Wed Dec 31, 2008 5:53 am

Hi all,

I am facing an error name "Cannt open DS_JOBOBJECTS" while opening a job in my project. Please help me in this. Thanks in advance.

ArndW · Post by **ArndW** » Wed Dec 31, 2008 6:33 am

You posted on another thread which looks like it might answer your question. You will need to explain where you are getting this error message, and what you might have tried to fix it. Also, if you look into your project directory on UNIX, is the subdirectory DS_JOBOBJECTS there, what are the access rights and what sizes are the files therein?

sathishmca · Post by **sathishmca** » Wed Dec 31, 2008 6:43 am

ArndW wrote:You posted on another thread which looks like it might answer your question. You will need to explain where you are getting this error message, and what you might have tried to fix it. Also, if you look into your project directory on UNIX, is the subdirectory DS_JOBOBJECTS there, what are the access rights and what sizes are the files therein?

I am facing this issue while opening job in data stage 7.5 designer..
what should be my next step?

ArndW · Post by **ArndW** » Wed Dec 31, 2008 6:50 am

The first step should be doing the actions I suggested in my first post.

sathishmca · Post by **sathishmca** » Wed Dec 31, 2008 6:52 am

ArndW wrote:The first step should be doing the actions I suggested in my first post. ...

i have seen the access rights for DS_JOBOBJECTS as -rwxrwxr-x ..

ArndW · Post by **ArndW** » Wed Dec 31, 2008 6:59 am

An how big are the 2 files in the subdirectory?

sathishmca · Post by **sathishmca** » Wed Dec 31, 2008 7:04 am

ArndW wrote:An how big are the 2 files in the subdirectory? ...

-rwxrwxr-x 2558976 Dec 31 02:54 OVER.30
-rwxrwxr-x 942080 Dec 31 02:54 DATA.30

Kindly help me..

ArndW · Post by **ArndW** » Wed Dec 31, 2008 7:10 am

That is good news, it means that there is still some data there. From the Administrator command do a "COUNT DS_JOBOJBECTS" and post the error message.

sathishmca · Post by **sathishmca** » Wed Dec 31, 2008 7:22 am

ArndW wrote:That is good news, it means that there is still some data there. From the Administrator command do a "COUNT DS_JOBOJBECTS" and post the error message. ...

Warning: Internal file corruption detected during file open!
file must be repaired, possible truncation
hsize: 2048
bsize: 2048
fsize: 2558976
Unable to open "DS_JOBOBJECTS" files.

ray.wurlod · Post by **ray.wurlod** » Wed Dec 31, 2008 2:48 pm

This potentially is bad news. Do you have an export/backup of your project?

To verify whether DS_JOBOBJECTS is indeed corrupted, run the following command, from the Administrator client Command window.

Code: Select all

UVFIXFILE DS_JOBOBJECTS

Post the results.

dspxguy · Post by **dspxguy** » Thu Apr 02, 2009 3:26 pm

I am having same issue here, DS_JOBOBJECTS looks corrupted.

Code: Select all

>UVFIXFILE DS_JOBOBJECTS
 
Beginning TRACE of DS_JOBOBJECTS.
 
ERROR: Processing Primary group 6358, Overflow group 0.
Bad backward link in oversize record.
Base addr = 0x00c6b000, Oversize addr = 0x04f1f000
 
CRITICAL ERROR! Notify the system administrator.
Abnormal termination of DataStage.
Fault type is 11.  Layer type is Unknown.
Program "/dsadm/Ascential/DataStage/DSEngine/bin/uvfixfile" terminated.  [SIGSEGV] segmentation violation

Can we fix it or need to take it from backup?

ray.wurlod · Post by **ray.wurlod** » Thu Apr 02, 2009 5:39 pm

You may be able to fix it. Did the disk where the project is become full at any point?

Take an operating system level backup of the DS_JOBOBJECTS directory and its contents.

Code: Select all

cp -ipr DS_JOBOBJECTS DS_JOBOBJECTS.BAK

Run fixtool on DS_JOBOBJECTS.

Code: Select all

$DSHOME/bin/fixtool -file DS_JOBOBJECTS

assuming that you're attached to the project directory and have environment variable DSHOME set.

If that command indicates that the errors are repairable, run again as DataStage Administrator with the -fix option.

Code: Select all

$DSHOME/bin/fixtool -fix -file DS_JOBOBJECTS

If that does not fix it, then you will need to have recourse to backups. Remove or rename DS_JOBOBJECTS before replacing it - restoring over the top of hashed files is bad practice. Once DS_JOBOBJECTS has been restored, check that its index references are OK. (This one is a TCL command.)

Code: Select all

SET.INDEX DS_JOBOBJECTS INFORM

In future take steps to prevent this file system from becoming full.

dspxguy · Post by **dspxguy** » Thu Apr 02, 2009 9:03 pm

Code: Select all

$DSHOME/bin/fixtool -file DS_JOBOBJECTS
Filename: DS_JOBOBJECTS
 
Start Diagnostics.
        0 Errors found in physical structure.
        0 Errors found in file header.
        7 Errors found in file groups.
        185 Other errors found in file.
 
        128535 records processed.
 
        192 Errors on file.
 
 
Fixtool Completed.

Code: Select all

$DSHOME/bin/fixtool -fix -file DS_JOBOBJECTS

Filename: DS_JOBOBJECTS
 
Start Diagnostics.
        0 Errors found in physical structure.
        0 Errors found in file header.
        7 Errors found in file groups.
        185 Other errors found in file.
 
        128535 records processed.
 
        192 Errors on file.
 
Start Fixing.
        52 Errors fixed.
 
Fixtool Completed.

Ran -fix again

Code: Select all

$DSHOME/bin/fixtool -file DS_JOBOBJECTS
Filename: DS_JOBOBJECTS
 
Start Diagnostics.
        0 Errors found in physical structure.
        0 Errors found in file header.
        3 Errors found in file groups.
        185 Other errors found in file.
 
        128535 records processed.
 
        188 Errors on file.
 
 
Fixtool Completed.

Code: Select all

COUNT DS_JOBOBJECTS
  File '/dsadm/Ascential/DataStage/Projects/healthplan/DS_JOBOBJECTS/OVER.30':
  Computed blink of 0x4F1F800 does not match expected blink of 0x3CA2000!
  Detected within group starting at address 0xC6B000!
  Internal data error.

If that does not fix it, then you will need to have recourse to backups. Remove or rename DS_JOBOBJECTS before replacing it - restoring over the top of hashed files is bad practice. Once DS_JOBOBJECTS has been restored, check that its index references are OK. (This one is a TCL command.)

We will get the project backup from Unix - So shall I rename DS_JOBOBJECTS? do I have to rename the I_DS_DSJOBOBJECTS too?

Another thing is if I do a count on DS_STAGETYPES and DS_TRANSFORMS
they both return

Code: Select all

Unable to open "DS_STAGETYPES" file.

Code: Select all

Unable to open "DS_TRANSFORMS" file.

I went into the directory of DS_STAGETYPES and DS_TRANSFORMS and found out that .TYpe30 is missing and OVER.30 is missing, i managed to copy .Type30 from a different project but what about the OVER.30, can I copy that too?
After the Project was corrupted I checked the DS_JOBOBJECTS directory and only saw DATA.30 in it and when I did SET.INDEX DS_JOBOBEJCTS it gave me an output that this file is Type 1 or TYpe19, Then I copied .Type30 from diffferent project into this Project and that error is gone. But DS_JOBOBJECTS is still corrupted and so is DS_STAGETYPES and DS_TRANSFORMS.
Please advise.

Thanks alot

ray.wurlod · Post by **ray.wurlod** » Thu Apr 02, 2009 9:46 pm

1. Restore all three from backups, removing or renaming the broken ones first. It will be faster than attempting repair.

2. Find out who (or which application) writes extraneous entries into, or removes OVER.30 and .Type30 files from, dynamic hashed files. Explain things to them with sufficient vigour.

3. At this time there is no need to worry about the D_* or I_* entries. There may be, but let's get the data portions up and running first.

dspxguy · Post by **dspxguy** » Fri Apr 03, 2009 9:41 am

Ray,

I ran another command to see what records in DS_JOBOBJECTS are corrupted.

Code: Select all

$DSHOME/bin/uvfixfile -f DS_JOBOBJECTS -v 8 -t ALL >/dev/null 2>trace.out

Output

Code: Select all

ERROR: Processing Primary group 6358, Overflow group 0.
Bad backward link in oversize record.
Base addr = 0x00c6b000, Oversize addr = 0x04f1f000


ERROR: Processing Primary group 7575, Overflow group 0.
Bad backward link in oversize record.
Base addr = 0x00ecb800, Oversize addr = 0x04f1e800


ERROR: Processing Primary group 12833, Overflow group 0.
Bad backward link in oversize record.
Base addr = 0x01910800, Oversize addr = 0x06539000


Warning: file load discrepancy detected.
Warning: No link to overflow group 177.
Warning: No link to overflow group 178.
Warning: No link to overflow group 179.
Warning: No link to overflow group 183.
Warning: No link to overflow group 184.
Warning: No link to overflow group 185.
Warning: No link to overflow group 186.
Warning: No link to overflow group 187.
Warning: No link to overflow group 188.
Warning: No link to overflow group 189.
Warning: No link to overflow group 190.
Warning: No link to overflow group 191.
Warning: No link to overflow group 192.
Warning: No link to overflow group 193.
Warning: No link to overflow group 194.
Warning: No link to overflow group 195.
Warning: No link to overflow group 196.
Warning: No link to overflow group 197.
Warning: No link to overflow group 202.
Warning: No link to overflow group 447.
Warning: No link to overflow group 448.
Warning: No link to overflow group 449.
Warning: No link to overflow group 530.
Warning: No link to overflow group 531.
Warning: No link to overflow group 532.
Warning: No link to overflow group 533.
Warning: No link to overflow group 534.
Warning: No link to overflow group 537.
Warning: No link to overflow group 538.
Warning: No link to overflow group 539.
Warning: No link to overflow group 540.
Warning: No link to overflow group 541.
Warning: No link to overflow group 785.
Warning: No link to overflow group 1260.
Warning: No link to overflow group 1312.
Warning: No link to overflow group 2885.
Warning: No link to overflow group 2886.
Warning: No link to overflow group 2887.
Warning: No link to overflow group 2906.
Warning: No link to overflow group 2907.
Warning: No link to overflow group 2908.
Warning: No link to overflow group 2909.
Warning: No link to overflow group 2910.
Warning: No link to overflow group 2944.
Warning: No link to overflow group 2945.
Warning: No link to overflow group 2946.
Warning: No link to overflow group 2948.
Warning: No link to overflow group 2949.
Warning: No link to overflow group 2966.
Warning: No link to overflow group 3007.
Warning: No link to overflow group 3008.
Warning: No link to overflow group 3009.
Warning: No link to overflow group 3010.
Warning: No link to overflow group 3012.
Warning: No link to overflow group 3013.
Warning: No link to overflow group 3015.
Warning: No link to overflow group 7007.
Warning: No link to overflow group 7857.
Warning: No link to overflow group 7858.
Warning: No link to overflow group 8993.
Warning: No link to overflow group 9445.
Warning: No link to overflow group 9446.
Warning: No link to overflow group 9447.
Warning: No link to overflow group 9448.
Warning: No link to overflow group 9449.
Warning: No link to overflow group 9450.
Warning: No link to overflow group 9451.
Warning: No link to overflow group 9452.
Warning: No link to overflow group 9453.
Warning: No link to overflow group 9454.
Warning: No link to overflow group 9455.
Warning: No link to overflow group 9456.
Warning: No link to overflow group 9457.
Warning: No link to overflow group 9519.
Warning: No link to overflow group 9520.
Warning: No link to overflow group 11135.
Warning: No link to overflow group 11136.
Warning: No link to overflow group 11137.
Warning: No link to overflow group 11138.
Warning: No link to overflow group 11139.
Warning: No link to overflow group 11140.
Warning: No link to overflow group 11141.
Warning: No link to overflow group 12180.
Warning: No link to overflow group 13749.
Warning: No link to overflow group 14147.
Warning: No link to overflow group 15428.
Warning: No link to overflow group 15429.
Warning: No link to overflow group 15430.
Warning: No link to overflow group 17863.
Warning: No link to overflow group 20446.
Warning: No link to overflow group 20601.
Warning: No link to overflow group 22826.
Warning: No link to overflow group 23986.
Warning: No link to overflow group 23987.
Warning: No link to overflow group 24581.
Warning: No link to overflow group 24582.
Warning: No link to overflow group 24583.
Warning: No link to overflow group 24584.
Warning: No link to overflow group 24585.
Warning: No link to overflow group 25164.
Warning: No link to overflow group 25169.
Warning: No link to overflow group 25895.
Warning: No link to overflow group 25896.
Warning: No link to overflow group 25897.
Warning: No link to overflow group 26385.
Warning: No link to overflow group 26992.
Warning: No link to overflow group 26997.
Warning: No link to overflow group 26998.
Warning: No link to overflow group 26999.
Warning: No link to overflow group 27000.
Warning: No link to overflow group 27001.
Warning: No link to overflow group 27002.
Warning: No link to overflow group 27003.
Warning: No link to overflow group 27004.
Warning: No link to overflow group 27005.
Warning: No link to overflow group 27006.
Warning: No link to overflow group 27007.
Warning: No link to overflow group 27008.
Warning: No link to overflow group 27009.
Warning: No link to overflow group 27040.
Warning: No link to overflow group 27429.
Warning: No link to overflow group 27430.
Warning: No link to overflow group 31161.
Warning: No link to overflow group 31162.
Warning: No link to overflow group 31188.
Warning: No link to overflow group 31383.
Warning: No link to overflow group 31661.
Warning: No link to overflow group 31662.
Warning: No link to overflow group 31663.
Warning: No link to overflow group 31664.
Warning: No link to overflow group 32011.
Warning: No link to overflow group 32181.
Warning: No link to overflow group 32182.
Warning: No link to overflow group 34462.
Warning: No link to overflow group 35552.
Warning: No link to overflow group 36717.
Warning: No link to overflow group 36719.
Warning: No link to overflow group 36720.
Warning: No link to overflow group 36723.
Warning: No link to overflow group 36724.
Warning: No link to overflow group 36725.
Warning: No link to overflow group 36814.
Warning: No link to overflow group 38346.
Warning: No link to overflow group 40506.
Warning: No link to overflow group 40507.
Warning: No link to overflow group 40508.
Warning: No link to overflow group 40520.
Warning: No link to overflow group 40521.
Warning: No link to overflow group 40522.
Warning: No link to overflow group 40523.
Warning: No link to overflow group 40524.
Warning: No link to overflow group 41795.
Warning: No link to overflow group 41796.
Warning: No link to overflow group 41797.
Warning: No link to overflow group 41798.
Warning: No link to overflow group 41799.
Warning: No link to overflow group 42713.
Warning: No link to overflow group 42723.
Warning: No link to overflow group 42724.
Warning: No link to overflow group 43026.
Warning: No link to overflow group 43027.
Warning: No link to overflow group 43945.
Warning: No link to overflow group 43946.
Warning: No link to overflow group 43947.
Warning: No link to overflow group 43949.
Warning: No link to overflow group 43950.
Warning: No link to overflow group 44500.
Warning: No link to overflow group 44501.
Warning: No link to overflow group 44675.
Warning: No link to overflow group 44676.
Warning: No link to overflow group 46885.
Warning: No link to overflow group 46886.
Warning: No link to overflow group 47860.
Warning: No link to overflow group 47894.
Warning: No link to overflow group 49944.
Warning: No link to overflow group 49945.
Warning: No link to overflow group 49946.
Warning: No link to overflow group 49947.
Warning: No link to overflow group 49948.
Warning: No link to overflow group 49950.
Warning: No link to overflow group 49952.
Warning: No link to overflow group 49953.
Warning: No link to overflow group 49954.
Warning: No link to overflow group 49955.
Warning: No link to overflow group 49956.
Warning: No link to overflow group 49958.

How long will it to repair this file? we will be contacting IBM Support and how long do you think they will take to repair it? And how bad is this file?
Have you seen signs of corruption like this before?

Please advise and thanks for all your help