Ignoring message with bad cookie. Has anybody seen this?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

abc123
Premium Member
Premium Member
Posts: 605
Joined: Fri Aug 25, 2006 8:24 am

Post by abc123 »

GOOD BOX:

core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 114688
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files (-n) 4096
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 2097
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited


PROBLEM BOX:

core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 98304
max locked memory (kbytes, -l) 32
max memory size (kbytes, -m) unlimited
open files (-n) 4096
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 2097
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

abc123 wrote:My ulimit -a has 2097.

I am definitely not exceeding that many processes. Isn't there a way to count how many processes are being spawned during the run?
Well if you're not sure how to count processes then you can't be sure you're not exceeding that limit.

I checked one of my 8.5 servers now where all credentials are mapped to dsadm and grep'ed on that ID as the process owner. It found 896 processes running, and it's after hours at the moment. I have processes(per user) set to unlimited.

You can grep on other things too, like osh. The -i flag is for case insensitive grep. AIX example:

Code: Select all

ps -ef | grep dsadm | wc -l
ps = process command
grep = filtering command
wc = word count command with -l for line count option (gives the count)

or

Code: Select all

ps -ef | grep -i osh | wc -l
Suggest running these commands on both servers before and during the times when you kick off 25+ jobs at once.
Choose a job you love, and you will never have to work a day in your life. - Confucius
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You might want to throw in a "grep -v grep" for good measure. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
pandeesh
Premium Member
Premium Member
Posts: 1399
Joined: Sun Oct 24, 2010 5:15 am
Location: CHENNAI, TAMIL NADU

Post by pandeesh »

Or

Code: Select all

ps -ef | grep [d]sadm | wc -l
ps -ef | grep -i  [o]sh | wc -l
if you dont want to type more... :)
pandeeswaran
eph
Premium Member
Premium Member
Posts: 110
Joined: Mon Oct 18, 2010 10:25 am

Post by eph »

Hi,

I don't know if I'm off-topic but could this be related to a wrong parameter value in the uvconfig file?
Previously I got trouble with the number of opened file descriptors (DS could open as many as the OS permitted). Then I changed values in the uvconfig according to IBM's proposal and get it worked.

Regards,
Eric
Post Reply