ds_ipcput() - timeout waiting for mutex

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
asaf_arbely
Premium Member
Premium Member
Posts: 87
Joined: Sat Jul 14, 2007 2:24 pm

ds_ipcput() - timeout waiting for mutex

Post by asaf_arbely »

Hi all,
I am using a server job that look like that : seq_file ->transformer -> transformer -> link_collector -> sort -> transformer -> aggregator ->transformer -> seq_file
The job uses inter process (with 512k buffer size)
When running on large amount of data I get an error:
ds_ipcput() - timeout waiting for mutex"
any suggestions?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Suggest a search is in order.
-craig

"You can never have too many knives" -- Logan Nine Fingers
asaf_arbely
Premium Member
Premium Member
Posts: 87
Joined: Sat Jul 14, 2007 2:24 pm

Post by asaf_arbely »

chulett wrote:Suggest a search is in order.
I searched the forum but haven't found any good suggestion for this problem
I'm looking for information about tuning my machine to prevent errors like this to happen
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Reduce the total load and in particular don't do anything that needs to wait for an unexpected amount of time. Had you searched for SPINTRIES you would have found more useful tuning information.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
asaf_arbely
Premium Member
Premium Member
Posts: 87
Joined: Sat Jul 14, 2007 2:24 pm

Post by asaf_arbely »

Manageg to resolve the error by reducing the buffer size of the job.

I don't realy know why it helped... any idea?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

One possible reason is physical memory. Large buffers used so much memory that the system began paging / swapping. This slowed user level processes down so much that your error occurred. This is only a guess, without additional data and your monitoring nobody can know for certain.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

That was my thought as well.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Any wait can cause it. Even waiting for DB2 to generate all the warnings it needs to before rolling back a transaction, if the timeout interval is set short enough or the server is busy enough. Saw one of those today.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

The warning are there for a reason (although in today's systems with much more memory some are a bit conservatively set) and should not be trifled with.

For the same reason, it is impossible to just give tuning suggestions without knowing exactly what the problem is; this is somewhat akin to going to a doctor and saying "I feel sick" and the doctor asks no further but prescribes Penicillin. Thus just changing UVCONFIG values without knowing the effects of the changes can make a system slow down or, in the worst case, stop functioning.
Post Reply