ulimit error

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pavan_test
Premium Member
Premium Member
Posts: 263
Joined: Fri Sep 23, 2005 6:49 am

ulimit error

Post by pavan_test »

My data stage job (v8.1) is aborting with the following error message;

Fatal Error: Need to be able to open at least 16 files; please check your ulimit setting for number of file descriptors
Failure during execution of operator logic.

I verified the ulimit (ulimit -a) and it has;
nofiles(descriptors) unlimited

can anyone please suggest me,

Thanks
Mark
Sreenivasulu
Premium Member
Premium Member
Posts: 892
Joined: Thu Oct 16, 2003 5:18 am

Post by Sreenivasulu »

Hi

You need to have a higher ulimit.
Pls refer the systemrequirement link in the IBM website.

Regards
Sreeni
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

how did you verify the ulimit value? The only way that yuo can really do and know what the current value is , is to put a before-job shell call into your job to list the job's actual runtime value.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Right, you have to check the job's environment not your command line environment even if they are 'the same user'. You'll see they are (or can be) different.
-craig

"You can never have too many knives" -- Logan Nine Fingers
bettyso
Premium Member
Premium Member
Posts: 7
Joined: Mon Apr 30, 2007 2:19 pm
Location: Canada

Any news

Post by bettyso »

Hi,

I have the same problem. We added the command ulimit -Ha in before job subroutine and the file descriptors are set to unlimited. Any idea why we still receive this error message? Thanks.

time(seconds) unlimited
file(blocks) unlimited
data(kbytes) unlimited
stack(kbytes) 4194304
memory(kbytes) unlimited
coredump(blocks) unlimited
nofiles(descriptors) unlimited


best regards
betty
Bso
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Betty, please start your own post rather than jump on someone else's. That way you can include all of your information including the error(s) you are seeing, even if they are "the same problem" as this poster's. Also make sure you let us know what flavor of UNIX you are running.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply