DS_JOBOBJECTS was corrupted

ArndW · Post by **ArndW** » Mon Jun 15, 2009 3:29 am

From UNIX, make 2 backup copies of your DS_JOBOBJECTS file. One backup is so that you have an unchanged backup, the second is to experiment with. Assume you call your copy "DSPLAY" at UNIX.
From the TCL prompt, enter "ED VOC DSPLAY", then in the editor "I" to enter insert mode, then 3 lines "F", "DSPLAY", "D_DS_JOBOBJECTS" then enter return again to enter edit mode and then "FILE". Now you can do a "UVFIXFILE DSPLAY FIX" and see what DataStage can recover. Please post the resulting output and also do a "COUNT DSPLAY" afterwards to see how many records are left.

datability_user · Post by **datability_user** » Mon Jun 15, 2009 6:31 am

Thank you ArndW for your quick replay,
do i have to have exclusive access to do this ?

from the time you replied, aim waiting to get exclusive access,

also, can you explain little bit those steps.

" then 3 lines "F", "DSPLAY", "D_DS_JOBOBJECTS" then enter return again to enter edit mode and then "FILE" "

ArndW · Post by **ArndW** » Mon Jun 15, 2009 6:40 am

Since DS_JOBOBJECTS is corrupted, you don't need exclusive access.

In the following, everything in red is what I entered:

.
$ dssh
DataStage Command Language 8.0 Licensed Materials - Property of IBM
(c) Copyright IBM Corp. 1997, 2006 All Rights Reserved.
DSEngine logged on: Monday, June 15, 2009 14:34

>SH
$ cp -r DS_JOBOBJECTS AW
$ exit
>ED VOC AW
New record.

----: I
0001= F
0002= D_DS_JOBOBJECTS
0003= AW
0004= {just hit <return> on an empty line to return to edit mode}
Bottom at line 3.
----: FILE
"AW" filed in file "VOC".
>UVFIXFILE AW FIX

User does not have superuser priviledges!
Disabling the FIX option and continuing.

Beginning TRACE of D_DS_JOBOBJECTS.
TRACE of D_DS_JOBOBJECTS completed.

Scanning overflow buffers.
Scan complete.

1 group(s) processed.
3 group buffer(s) processed.
13 record(s) processed.
Number of data bytes = 1264.
>QUIT

datability_user · Post by **datability_user** » Mon Jun 15, 2009 7:29 am

Thank you again ArndW;

The fact that we still able to run jobs, so, we have some jobs running right now, because of this i asked about the exclusive access.
So, can i still proceed with your advice?

ArndW · Post by **ArndW** » Mon Jun 15, 2009 10:20 am

Yes, you can issue the UNIX "cp" commands while the system is running, it won't break anything.

kduke · Post by **kduke** » Mon Jun 15, 2009 10:59 am

Awesome answer Arnd. Well done.

ray.wurlod · Post by **ray.wurlod** » Mon Jun 15, 2009 4:00 pm

One vital point is that you must have Administrator access to be able to use the FIX option on UVFIXFILE.

Another point is that fixtool is the preferred utility over UVFIXFILE these days.

Code: Select all

fixtool -file AW -level 5 [ -fix ]

Again you need to be Administrator to use the -fix option. The fixtool command is executed from the operating system command level - it is not necessary to open a dssh shell.

datability_user · Post by **datability_user** » Tue Jun 16, 2009 3:15 am

we followed your valuable advise, and we got the following:

>ED VOC /ascential/Ascential/DataStage/Projects/Project1/AW
New record.

----: i
0001= F
0002= D_DS_JOBOBJECTS
0003= AW
0004=
Bottom at line 3.
----: FILE
"/ascential/Ascential/DataStage/Projects/Project1/AW" filed in file "VOC".
>UVFIXFILE /ascential/Ascential/DataStage/Projects/Project1/AW
D_DS_JOBOBJECTS: No such file or directory
>ED VOC /ascential/Ascential/DataStage/Projects/Project1/AW
3 lines long.

----: I
0001= F
0002= /ascential/Ascential/DataStage/Projects/Project1/D_DS_JOBOBJECTS
0003= /ascential/Ascential/DataStage/Projects/Project1/AW
0004=
----: FILE
"/ascential/Ascential/DataStage/Projects/Project1/AW" filed in file "VOC".
>UVFIXFILE /ascential/Ascential/DataStage/Projects/Project1/AW FIX

Beginning TRACE of /ascential/Ascential/DataStage/Projects/Project1/D_DS_JOBOBJECTS.
TRACE of /ascential/Ascential/DataStage/Projects/Project1/D_DS_JOBOBJECTS completed.

Scanning overflow buffers.
Scan complete.

1 group(s) processed.
4 group buffer(s) processed.
14 record(s) processed.
Number of data bytes = 2116.
>

fixtool -file /ascential/Ascential/DataStage/Projects/Project1/AW -level 5 [ -fix ]

0012bd738 F:000000000 B:0012bd52c W:000004004
Processing group: 9595
0012bd800 F:0012bd87c B:00000007c W:000000c03
ID: 'J\765\V48S1'
DATA: 'NRO�CSeqFileStage�IMSI_Not_Found_seq��2�V48S1P1��1��0�1�CMetaProperty/0��1�0�0�CSeqFileStage�+ظ�+ظ|'
0012bd87c F:0012bd8f8 B:0012bd87c W:000000c03
ID: 'J\2425\V5S1P1'
DATA: 'NRO�CSeqInput�DSLink4��V0S4�/tmp/OMR/File_4.txt�,�"�0�0�0�0��0�0�CMetaProperty/0��0�0�0�0�#'
0012bd8f8 F:0012bd958 B:0012bd81c W:000000c03
ID: 'J\2652\V0S75P4'
DATA: 'NRO�CTrxInput�FromSrcMedMSISDNHsh��V20S0��2�CMetaProperty/0��'
0012bd958 F:0012bd9d8 B:0012bd878 W:000000803
ID: 'J\3294\V0S6'
DATA: 'NRO�CHashedFileStage�Hashed_File_6��4��V0S6P2�/backups/Shadi��CMetaProperty/0��0�0�CHashedFileStage+ع�+ع|'
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
ID: 'J\3738\V11S4P35'
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9fc F:000000000 B:0012bdfdc W:000004004
17 Errors found in file groups.
0 Other errors found in file.

73273 records processed.

17 Errors on file.

Start Fixing.
11 Errors fixed.

Fixtool Completed.
PuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY$ uTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY
sh: uTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY: not found.

After running fixtool again, below is the result

0012bd8f8 F:0012bd958 B:0012bd81c W:000000c03
ID: 'J\2652\V0S75P4'
DATA: 'NRO�CTrxInput�FromSrcMedMSISDNHsh��V20S0��2�CMetaProperty/0��'
0012bd958 F:0012bd9d8 B:0012bd878 W:000000803
ID: 'J\3294\V0S6'
DATA: 'NRO�CHashedFileStage�Hashed_File_6��4��V0S6P2�/backups/Shadi��CMetaProperty/0��0�0�CHashedFileStage+ع�+ع|'
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
ID: 'J\3738\V11S4P35'
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9d8 F:0012bd9fc B:0012bd97c W:000000903
0012bd9fc F:000000000 B:0012bdfdc W:000004004
0 Errors found in file groups.
0 Other errors found in file.

73265 records processed.

No errors were found.

Fixtool Completed.
PuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY$ uTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY
sh: uTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTYPuTTY: not found.

ArndW · Post by **ArndW** » Tue Jun 16, 2009 3:22 am

Although I would have used different filenames, your run looks good. The output indicates no data was truncated by the fix command and you just had group errors which were corrected. You might wish to delete or check the job "/backups/Shadi" after fixing your "live" DS_JOBOBJECTS file - but that needs to be done when no other users are in the system and please make another copy of the DS_JOBOBJECTS file prior to attempting the fix.

datability_user · Post by **datability_user** » Tue Jun 16, 2009 3:34 am

thank you very much for your quick reply, we can close all Datastage sessions, but we have running jobs now, and they will take sometime, is OK to do the fix while we have running jobs?

ray.wurlod · Post by **ray.wurlod** » Tue Jun 16, 2009 4:25 pm

It is ok to do the fix while jobs are running - DS_JOBOBJECTS contains only design-time information.

Do, however, heed the advice to back up the file before "fixing" it - the "fix" can in some circumstances truncate portions of the hashed file.

datability_user · Post by **datability_user** » Wed Jun 17, 2009 4:45 am

Thank you very much ArndW, Ray for your help to resolve our problem,

we have done the fix and we are able to COUNT DS_JOBOBJECTS and also able to export jobs (we can't before the fix).

Only now we start taking full export for our project, after making sure every thing is fine i will update you and mark this topic as resolved.

thanx again for all,

the only thing that bothering us is our failure to create any new project,
if there is any input/hint on that we are very thankfull.

ArndW · Post by **ArndW** » Wed Jun 17, 2009 5:02 am

In that case you can mark this thread as resolved and then open up a new thread with your new problem.

datability_user · Post by **datability_user** » Sat Jun 20, 2009 6:13 am

thank you,

i will do that.

Note : our weekend is Thursday & Friday