Error in Sort stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Marcus426
Participant
Posts: 33
Joined: Wed Sep 09, 2009 1:37 am

Error in Sort stage

Post by Marcus426 »

Hi guys,


We recently migrated from 8.0.1 to 8.1. I am trying to run a job in 8.1 which ran successfully on 8.0.1. The job fails and is throwing the following error. The 8.1 operating system is AIX and the 8.0.1 os isSun Solaris

"Sort_168,0: Fatal Error: Need to be able to open at least 16 files; please check your ulimit setting for number of file descriptors"

My job looks like this

Code: Select all


seq file ------------> Transformer------------> sort -----------> seq file.


Can any of you guys help me out.!
Last edited by Marcus426 on Tue Oct 20, 2009 9:07 am, edited 1 time in total.
louwdata
Participant
Posts: 8
Joined: Tue Oct 20, 2009 6:15 am
Location: Midrand

Post by louwdata »

What is you ulimit settting in the uvconfig file
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

In the before-job call for this job, add a shell call to "ulimit -a" and see if you really only have 16 file units available. If so, you need to have your system administrator fix this in smitty immediately.
Marcus426
Participant
Posts: 33
Joined: Wed Sep 09, 2009 1:37 am

Post by Marcus426 »

louwdata wrote:What is you ulimit settting in the uvconfig file

Sorry for being stupid, but how can I check that?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

It's probably not set there at all. Try what Arnd suggested first.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Marcus426
Participant
Posts: 33
Joined: Wed Sep 09, 2009 1:37 am

Post by Marcus426 »

ok criag!
datskosaraju
Premium Member
Premium Member
Posts: 48
Joined: Tue Nov 25, 2008 11:10 pm
Location: Des Moines,IA

Post by datskosaraju »

That is an issue with 64 bit unix operating systems. This can be avoided by changing the nofiles option in DS_env file from unlimited to 8196.
"It's easier to go down a hill than up it but the view is much better at the top"
-Bennet,Arnold
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

As noted, they meant the "dsenv" file rather than "uvconfig". It lives in the main $DSHOME directory called DSEngine as an editable, plain text file.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply