Sort stage error: Error in merging files
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 21
- Joined: Tue Apr 06, 2004 10:09 am
Sort stage error: Error in merging files
I'm having an error in a sort stage where i'm getting the following error:
cl5928Fac00262..sortFac: Error in merging files
Unix error: /ascential/DataStage/Projects/advprod/sokZqlaa/err: Error 0
I've tried bumping up the number of rows in virtual memory and using the max number of sort files, but nothing seems to be helping. Any ideas? The file that is going through this stage has about 6 million rows.
Thanks!
cl5928Fac00262..sortFac: Error in merging files
Unix error: /ascential/DataStage/Projects/advprod/sokZqlaa/err: Error 0
I've tried bumping up the number of rows in virtual memory and using the max number of sort files, but nothing seems to be helping. Any ideas? The file that is going through this stage has about 6 million rows.
Thanks!
Running out of temp space? Make sure you specify in the 'Temporary Director' property somewhere that has plenty o' room. Leaving that blank defaults to the Project, which seems like what you are doing. It is generally considered to be a Bad Thing to fill that space up. ![Wink :wink:](./images/smilies/icon_wink.gif)
![Wink :wink:](./images/smilies/icon_wink.gif)
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 21
- Joined: Tue Apr 06, 2004 10:09 am
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
Check that the kernel parameters are set to at least the recommended values according to the Install and Upgrade Guide. We also had to increase the 'maxdsiz' kernel parameter (We're on HP/UX) to up the ulimit value. I don't recall if we were getting the exact same error, but we were definitely seeing "Abnormal termination of stage".
Good Luck,
Tony
Good Luck,
Tony
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Is /ascential/DataStage/Projects/advprod/sokZqlaa/err a file? If so, what's in it? (I'm thinking it might be an error log containing extra diagnostic information. I could be off target there.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 21
- Joined: Tue Apr 06, 2004 10:09 am
No, there isn't a /ascential/DataStage/Projects/advprod/sokZqlaa/err file. I did notice, however, that one of the files in /ascential/DataStage/Projects/advprod/sokZqlaa/ is irregularly sized. All of the opv__xx are one size except for one which is around 2GB. Is there a file size limit on these sort temp files?
-
- Participant
- Posts: 21
- Joined: Tue Apr 06, 2004 10:09 am
-
- Participant
- Posts: 21
- Joined: Tue Apr 06, 2004 10:09 am
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
Create a new server job.
Open the Job Properties dialog.
Go to the Job Control tab.
Paste in the following code:
Compile and run the job. The ulimit will be in the job log.
HTH,
Tony
Open the Job Properties dialog.
Go to the Job Control tab.
Paste in the following code:
Code: Select all
Execute "SH -c 'ulimit -a'" Capturing Uout
Call DSLogInfo("Ulimit ":Uout,"Job Control")
HTH,
Tony
-
- Participant
- Posts: 21
- Joined: Tue Apr 06, 2004 10:09 am
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA