Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
Marcus426
Participant
Posts: 33 Joined: Wed Sep 09, 2009 1:37 am
Post
by Marcus426 » Tue Oct 20, 2009 7:23 am
Hi guys,
We recently migrated from 8.0.1 to 8.1. I am trying to run a job in 8.1 which ran successfully on 8.0.1. The job fails and is throwing the following error. The 8.1 operating system is AIX and the 8.0.1 os isSun Solaris
"Sort_168,0: Fatal Error: Need to be able to open at least 16 files; please check your ulimit setting for number of file descriptors"
My job looks like this
Code: Select all
seq file ------------> Transformer------------> sort -----------> seq file.
Can any of you guys help me out.!
Last edited by
Marcus426 on Tue Oct 20, 2009 9:07 am, edited 1 time in total.
louwdata
Participant
Posts: 8 Joined: Tue Oct 20, 2009 6:15 am
Location: Midrand
Post
by louwdata » Tue Oct 20, 2009 7:28 am
What is you ulimit settting in the uvconfig file
ArndW
Participant
Posts: 16318 Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Post
by ArndW » Tue Oct 20, 2009 7:29 am
In the before-job call for this job, add a shell call to "ulimit -a" and see if you really only have 16 file units available. If so, you need to have your system administrator fix this in smitty immediately.
Marcus426
Participant
Posts: 33 Joined: Wed Sep 09, 2009 1:37 am
Post
by Marcus426 » Tue Oct 20, 2009 7:40 am
louwdata wrote: What is you ulimit settting in the uvconfig file
Sorry for being stupid, but how can I check that?
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Tue Oct 20, 2009 7:42 am
It's probably not set there at all. Try what Arnd suggested first.
-craig
"You can never have too many knives" -- Logan Nine Fingers
datskosaraju
Premium Member
Posts: 48 Joined: Tue Nov 25, 2008 11:10 pm
Location: Des Moines,IA
Post
by datskosaraju » Tue Oct 20, 2009 1:39 pm
That is an issue with 64 bit unix operating systems. This can be avoided by changing the nofiles option in DS_env file from unlimited to 8196.
"It's easier to go down a hill than up it but the view is much better at the top"
-Bennet,Arnold
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Tue Oct 20, 2009 1:59 pm
As noted, they meant the "dsenv" file rather than "uvconfig". It lives in the main $DSHOME directory called DSEngine as an editable, plain text file.
-craig
"You can never have too many knives" -- Logan Nine Fingers