INPUT_TO_AGGR: ds_ipcput() - timeout waiting for mutex

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

hi,
I got another error, it says :
sort2 failed and
Abnormal termination of stage DB2_INVOICE_LINE_ITEM_RPT_partition1.. detected
i am doing sort in all three aggregators : inv_id a
and i also add ascending sorting order for inv_id in all three aggregators but i still get this error. sort 2 failed. The other two sorts works fine as there are three sorts.

thanks
shivan
vinaymanchinila wrote:I had the same issue with the aggregator when I did NOT use the Sort stage, and I had 2.5 million records.

I sorted the data and it now works fine!
vinaymanchinila
Premium Member
Premium Member
Posts: 353
Joined: Wed Apr 06, 2005 8:45 am

Post by vinaymanchinila »

Can you checl to see if it is the same order of columns you have mentioned in the aggregator?
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

hi,
it is same. One more thing i noticed is that when i assign ascending order to primary key inv_id in the aggregator. It doesnt save it. Because when i go back, the ascending sort order is not there.

shivan
vinaymanchinila wrote:Can you checl to see if it is the same order of columns you have mentioned in the aggregator?
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Did you reset and check the error? I think it is due to memory issue that the agg cannot hold.

Did you test the same with small volumes?
vinaymanchinila
Premium Member
Premium Member
Posts: 353
Joined: Wed Apr 06, 2005 8:45 am

Post by vinaymanchinila »

No, it should stick around. Did you fill out the Sort field first with a number to show which is 1, 2, etc?

_________________
Craig Hulett

Check this post by me , it was of great help.

viewtopic.php?p=138007&highlight=#138007
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

hi,
i worked fine with small amount of data like upto 600 thousand records. So if it is a memory issure, how i can increase the buffer. I turned the inter-processor on, and set the default buffer of 128kb.

thanks
shivan
Sainath.Srinivasan wrote:Did you reset and check the error? I think it is due to memory issue that the agg cannot hold.

Did you test the same with small volumes?
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

i did that.

thanks
shivan
vinaymanchinila wrote:No, it should stick around. Did you fill out the Sort field first with a number to show which is 1, 2, etc?

_________________
Craig Hulett

Check this post by me , it was of great help.

viewtopic.php?p=138007&highlight=#138007
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

i have five primary keys, I add the sort order 1 -5 in all of them. Now i get this error.
CopyOfDB2_INVOICE_LINE_ITEM_RPT_part..Sort_117: Error in merging files
At row 1, link "DSLink121"
Call to output link returned numeric error code: 17

thanks
shivan
shivan wrote:i did that.

thanks
shivan
vinaymanchinila wrote:No, it should stick around. Did you fill out the Sort field first with a number to show which is 1, 2, etc?

_________________
Craig Hulett

Check this post by me , it was of great help.

viewtopic.php?p=138007&highlight=#138007
vinaymanchinila
Premium Member
Premium Member
Posts: 353
Joined: Wed Apr 06, 2005 8:45 am

Post by vinaymanchinila »

Hey Shivan,
What are you trying to Merge?

Do it with like 10 rows to see all your 3 Sort/Aggregator stages work

Then use the merge if you have to merge , in that case you can isolate the issue.
Thanks,
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

it worked fine with 1000 rows. Otherwise i get this error:
DB2_INVOICE_LINE_ITEM_RPT_partition1..Sort_4: Error in merging files
At row 1, link "DSLink118"
Call to output link returned numeric error code: 17

how can i do the merge?

shivan
vinaymanchinila wrote:Hey Shivan,
What are you trying to Merge?

Do it with like 10 rows to see all your 3 Sort/Aggregator stages work

Then use the merge if you have to merge , in that case you can isolate the issue.
Thanks,
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

this is an another error i got:
CopyOfDB2_INVOICE_LINE_ITEM_RPT_part1..Link_Collector_Out: [IBM][CLI Driver] CLI0108E Communication link failure. SQLSTATE=40003

shivan
shivan wrote:it worked fine with 1000 rows. Otherwise i get this error:
DB2_INVOICE_LINE_ITEM_RPT_partition1..Sort_4: Error in merging files
At row 1, link "DSLink118"
Call to output link returned numeric error code: 17

how can i do the merge?

shivan
vinaymanchinila wrote:Hey Shivan,
What are you trying to Merge?

Do it with like 10 rows to see all your 3 Sort/Aggregator stages work

Then use the merge if you have to merge , in that case you can isolate the issue.
Thanks,
tacitus
Participant
Posts: 13
Joined: Fri Feb 25, 2005 5:46 pm
Location: Boston, MA

Post by tacitus »

Hi Shivan,

Just want to rule out the obvious...Have you tried increasing your buffer size and timeout? If this didn't work and the sort mentioned didn't you might want to talk to Ascential about disabling the Notify function. It impacts IPC between child and parent and has known issues that can manifest as the timeout waiting for mutex error.
shivan
Participant
Posts: 70
Joined: Mon Jul 25, 2005 9:29 am

Post by shivan »

hi,
i tried to increase the buffer size from 128 to 200 kb. I also increased the time from 10 secs to 50 secs. But it didnt worked. Can you explain me what is Notify function , as i m new to datastage.

thanks
shivan
tacitus wrote:Hi Shivan,

Just want to rule out the obvious...Have you tried increasing your buffer size and timeout? If this didn't work and the sort mentioned didn't you might want to talk to Ascential about disabling the Notify function. It impacts IPC between child and parent and has known issues that can manifest as the timeout waiting for mutex error.
Post Reply