Link Collector Problem
Moderators: chulett, rschirm, roy
Link Collector Problem
Hi All,
I have encountered the following error in one of my datastage jobs using one Link Collector SOMETIMES which results in abort. After i reset it and run again, it would be ok. Thus, im puzzled as it would occur unpredictably as there are situations whereby continuous runs of 3-4 times are successful.
S10..MergeAll.Rejected: ds_ipcclose() - Error in mutex_unlock() - Operation not permitted.
DS10..MergeAll.Rejected: DSD.INTClose Error 11 in GCI close.
DS10..Compare: ds_ipcopen() - Error in open(/tmp/TMOPT.DS10..Compare) - A file or directory in the path name does not exist.
DS10..MergeAll: |Error 11 in GCI Link initialisation.|
Attempting to Cleanup after ABORT raised in stage DS10..MergeAll
DataStage Job 15 Phantom 8325
DS10..MergeAll.Rejected: DSD.INTClose Error 11 in GCI close.
DataStage Phantom Finished
Can anyone please enlighten on what may be the problem?
I have encountered the following error in one of my datastage jobs using one Link Collector SOMETIMES which results in abort. After i reset it and run again, it would be ok. Thus, im puzzled as it would occur unpredictably as there are situations whereby continuous runs of 3-4 times are successful.
S10..MergeAll.Rejected: ds_ipcclose() - Error in mutex_unlock() - Operation not permitted.
DS10..MergeAll.Rejected: DSD.INTClose Error 11 in GCI close.
DS10..Compare: ds_ipcopen() - Error in open(/tmp/TMOPT.DS10..Compare) - A file or directory in the path name does not exist.
DS10..MergeAll: |Error 11 in GCI Link initialisation.|
Attempting to Cleanup after ABORT raised in stage DS10..MergeAll
DataStage Job 15 Phantom 8325
DS10..MergeAll.Rejected: DSD.INTClose Error 11 in GCI close.
DataStage Phantom Finished
Can anyone please enlighten on what may be the problem?
-
- Participant
- Posts: 18
- Joined: Mon Jul 07, 2003 12:56 am
- Location: India
-
- Premium Member
- Posts: 1044
- Joined: Wed Sep 29, 2004 3:30 am
- Location: Nottingham, UK
- Contact:
Re: Link Collector Problem
I am having the same problem. The job failed twice, then worked. Here are some error messages:cheerfu1 wrote:Hi All,
I have encountered the following error in one of my datastage jobs using one Link Collector SOMETIMES which results in abort. After i reset it and run again, it would be ok. Thus, im puzzled as it would occur unpredictably as there are situations whereby continuous runs of 3-4 times are successful.
Message: AR_CES_IM_J05_DMR3_DOC_Create_Segments..Collate_GL_entries.E1BPACGL09_vendor: ds_ipcflush() - Error in mutex_unlock() - Not owner
Message: AR_CES_IM_J05_DMR3_DOC_Create_Segments..Collate_GL_entries.E1BPACGL09_vendor: DSD.INTClose Error 11 in GCI close.
Message: AR_CES_IM_J05_DMR3_DOC_Create_Segments..Populate_customer_segments.E1BPACGL09_customer: Run stopped after 1547 rows
Any ideas? The only thing that I did before the third run (which worked) is to delete the destination files, but there was no problem with file permissions.
Phil Hibbs | Capgemini
Technical Consultant
Technical Consultant
-
- Premium Member
- Posts: 385
- Joined: Wed Jun 16, 2004 12:43 pm
- Location: Virginia, USA
- Contact:
Some of your problems may be version specific. In version 7.something, the collector and partitioner were rewritten to perform non-blocking I/O. This solves most problems. Prior to the rewrite, if a collector or partitioner became starved for resources, it could hang. Uneven row counts on the partitioned links was also a problem at earlier releases.
I also suspect that having more processes trying to write to the same job log may also create a problem. However, this may be solved by changes in the uvconfig file, but I have not tested this, yet.
I also suspect that having more processes trying to write to the same job log may also create a problem. However, this may be solved by changes in the uvconfig file, but I have not tested this, yet.
Chuck Smith
www.anotheritco.com
www.anotheritco.com
Re: Link Collector Problem
Unix file permissions may cause this kind of problem if you run the job under different userIDs, expecially when the userIDs are in different groups and have different rights.
chunsli
chunsli
cheerfu1 wrote:Hi All,
I have encountered the following error in one of my datastage jobs using one Link Collector SOMETIMES which results in abort. After i reset it and run again, it would be ok. Thus, im puzzled as it would occur unpredictably as there are situations whereby continuous runs of 3-4 times are successful.
S10..MergeAll.Rejected: ds_ipcclose() - Error in mutex_unlock() - Operation not permitted.
DS10..MergeAll.Rejected: DSD.INTClose Error 11 in GCI close.
DS10..Compare: ds_ipcopen() - Error in open(/tmp/TMOPT.DS10..Compare) - A file or directory in the path name does not exist.
DS10..MergeAll: |Error 11 in GCI Link initialisation.|
Attempting to Cleanup after ABORT raised in stage DS10..MergeAll
DataStage Job 15 Phantom 8325
DS10..MergeAll.Rejected: DSD.INTClose Error 11 in GCI close.
DataStage Phantom Finished
Can anyone please enlighten on what may be the problem?
link collector not effiective
I have same problem, so I seldom use link collector.
when I have to use, I use hash file. or I write into several sequentail file and then cat then after jobs.
when I have to use, I use hash file. or I write into several sequentail file and then cat then after jobs.
Re: link collector not effiective
Hi,
I think it is a performance issue,check out in performance tab which option is checked-user-project defaults if so then check all those parameter in administrator ,if not then check inter process under Enable row buffer option and increase the time out-say 60sec-since u r facing mutex error it might be problem of dead lock.
I think it is a performance issue,check out in performance tab which option is checked-user-project defaults if so then check all those parameter in administrator ,if not then check inter process under Enable row buffer option and increase the time out-say 60sec-since u r facing mutex error it might be problem of dead lock.
-
- Premium Member
- Posts: 1044
- Joined: Wed Sep 29, 2004 3:30 am
- Location: Nottingham, UK
- Contact:
Re: Link Collector Problem
Like I said, it was not a file permissions problem.chunsli wrote:Unix file permissions may cause this kind of problem if you run the job under different userIDs,
Phil Hibbs | Capgemini
Technical Consultant
Technical Consultant
Re: Link Collector Problem
On a project I was working on we were having mutex errors while using link collectors. They were running datastage 7.5.1 on a AIX server. Seems that there was a glitch in he AIX operating system which was causing the mutex error on any jobs using a link collecter.
Anyone here that is having mutex errors running on a AIX server?
Tim
Anyone here that is having mutex errors running on a AIX server?
Tim