Join Throws error
Moderators: chulett, rschirm, roy
Join Throws error
I am trying to do a join on two oracle tables Datastage 8.0.1 but the job aborts and gives me the following error:
Join_97,1: Failure during execution of operator logic.
Join_97,1: Input 0 consumed 9 records.
Join_97,1: Output 0 produced 9 records.
Join_97,1: Fatal Error: Pipe write failed: Broken pipe
Join_97,0: Failure during execution of operator logic.
Oracle_Enterprise_85,0: sendWriteSignal() failed on node SVKCDISD01 ds = 0 conspart = 1 Broken pipe
Oracle_Enterprise_85,0: Could not send close message (shared memory)
node_node1: Player 2 terminated unexpectedly.
node_node2: Player 2 terminated unexpectedly.
main_program: APT_PMsectionLeader(1, node1), player 2 - Unexpected exit status 1.
APT_PMsectionLeader(2, node2), player 2 - Unexpected exit status 1.
main_program: Step execution finished with status = FAILED.
But when I use a Lookup stage instead of a join stage My job runs successfully. My reference tables have lot of data, so using a lookup is not an option.
Can anyone help suggesting a possible reason as to why this is happening?
Thanks
Join_97,1: Failure during execution of operator logic.
Join_97,1: Input 0 consumed 9 records.
Join_97,1: Output 0 produced 9 records.
Join_97,1: Fatal Error: Pipe write failed: Broken pipe
Join_97,0: Failure during execution of operator logic.
Oracle_Enterprise_85,0: sendWriteSignal() failed on node SVKCDISD01 ds = 0 conspart = 1 Broken pipe
Oracle_Enterprise_85,0: Could not send close message (shared memory)
node_node1: Player 2 terminated unexpectedly.
node_node2: Player 2 terminated unexpectedly.
main_program: APT_PMsectionLeader(1, node1), player 2 - Unexpected exit status 1.
APT_PMsectionLeader(2, node2), player 2 - Unexpected exit status 1.
main_program: Step execution finished with status = FAILED.
But when I use a Lookup stage instead of a join stage My job runs successfully. My reference tables have lot of data, so using a lookup is not an option.
Can anyone help suggesting a possible reason as to why this is happening?
Thanks
The first error is a write error in the Join stage, so that leads to the question of what stage is that? If you make a test copy of your job and output to a peek stage, does the error remain?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Re: Join Throws error
Hi,r_arora wrote:I am trying to do a join on two oracle tables Datastage 8.0.1 but the job aborts and gives me the following error:
Join_97,1: Failure during execution of operator logic.
Join_97,1: Input 0 consumed 9 records.
Join_97,1: Output 0 produced 9 records.
Join_97,1: Fatal Error: Pipe write failed: Broken pipe
Join_97,0: Failure during execution of operator logic.
Oracle_Enterprise_85,0: sendWriteSignal() failed on node SVKCDISD01 ds = 0 conspart = 1 Broken pipe
Oracle_Enterprise_85,0: Could not send close message (shared memory)
node_node1: Player 2 terminated unexpectedly.
node_node2: Player 2 terminated unexpectedly.
main_program: APT_PMsectionLeader(1, node1), player 2 - Unexpected exit status 1.
APT_PMsectionLeader(2, node2), player 2 - Unexpected exit status 1.
main_program: Step execution finished with status = FAILED.
But when I use a Lookup stage instead of a join stage My job runs successfully. My reference tables have lot of data, so using a lookup is not an option.
Can anyone help suggesting a possible reason as to why this is happening?
Thanks
Let me know what else stage you used in that job. I fell it might be because of using the function in wrong manner.
Sura
Re: Join Throws error
Im just joining two oracle stages..and writting the result in a sequential file directly. I have not used the transformer also. Just writting the results directly to a sequential file.
-
- Charter Member
- Posts: 560
- Joined: Wed Jul 13, 2005 5:36 am
- Location: Ohio
KrazyKoolRohit - that is an interesting post. I'm unclear as to how those value could affect execution; could you perhaps explain that?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Charter Member
- Posts: 560
- Joined: Wed Jul 13, 2005 5:36 am
- Location: Ohio
ArndW,
I faced the same issue yesterday and was browind DSX for the resolution. I found a lot of thread discussing this issue.
ex: viewtopic.php?t=116566&start=0&postdays ... NITOR_SIZE
I changed the parameters and got rid of the fatal warnings.. so thought it might help r_arora as well.
I faced the same issue yesterday and was browind DSX for the resolution. I found a lot of thread discussing this issue.
ex: viewtopic.php?t=116566&start=0&postdays ... NITOR_SIZE
I changed the parameters and got rid of the fatal warnings.. so thought it might help r_arora as well.
KrazyKoolRohit - Thanks, I see now! I am not sure that the error causes are related, but they are similar and it is certainly worth a try to see if it makes a difference.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
r_arora - the APT_... value changes were a long shot but worth trying.
What are the data volumes for the two links and could you tell us what you are doing in the join?
What are the data volumes for the two links and could you tell us what you are doing in the join?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Can you monitor your scratch space while running this job? Also, if you halve the number of rows does the job run through (i.e. determine if your error is caused by data volumes)?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>