The current limit on number of open files should be raised

satheesh.mohandass · Post by **satheesh.mohandass** » Wed Aug 19, 2009 2:57 pm

One of my Datastage 8.0 Parallel Job aborts with the following message

main_program: Fatal Error: Could not open file /tmp/dynLUT15464f5607f5": Too many open files; The current limit on number of open files (1024) should be raised (both hard and soft)

I set the no of files open settings as shown below in /etc/security/limits.conf file in Red hat linux server

* hard nofile 4096
* soft nofile 63536

But still when i re run the job i get the same above error. Any quick response will be deeply appreciated.

chulett · Post by **chulett** » Wed Aug 19, 2009 3:32 pm

Perhaps this will help:

viewtopic.php?t=111077

satheesh.mohandass · Post by **satheesh.mohandass** » Thu Aug 20, 2009 9:31 am

Hi Craig,

Thanks for your reply but the link you provided didn't help me much in resolving the issue.

I tried to modify the Ulimit no of files open settings in users .profile , dsenv file and limits.conf file. But none of these settings are in effect when i run the datstage job. i still get the same error "The current limit on number of open files (1024) should be raised (both hard and soft) "

I also placed ulimit -a in befor ejob subroutine to find out the value of no of open files and it always shows 1024.

ArndW · Post by **ArndW** » Thu Aug 20, 2009 9:59 am

You need to change the limits of the user under which the DataStage jobs run and then restart the DataStage engine.

<If your platform is LINUX, ignore this post. I didn't read the full problem description. >

chulett · Post by **chulett** » Thu Aug 20, 2009 10:15 am

It wasn't really meant to resolve anything, per se, what I got from the linked post was that it was unresolvable by any config change. You need to restructure your process to do "less things" at a time.