Limits on number of links out of a Switch/ into a Join
Posted: Fri May 18, 2007 5:06 am
Hi guys,
This is a bit of a long shot but...
I have a job design here which uses a Switch stage which feeds a Join. The Switch and Join are both fed by datasets. On the Switch output, there are 18 links in all. We frequently get failures on this job, but it is not contention-related as I have tried running these one by one, in isolation, and furthermore, it doesn't seem to be volume-related as it happens equally on small and larger data volumes.
The error we see seems to actually relate to the Join stage (which takes in the 18 links from the Switch), namely:
"node_node1: Player 19 terminated unexpectedly"
"main_program: Unexpected termination by Unix signal 9(SIGKILL)"
Does anyone know if there is some kind of limit we should adhere to, when exiting data from a Switch or the number of links a Join can take as an input?
Multiple re-runs of these jobs do end successfully (usually after 3 or 4 attempts)
Cheers fellas
This is a bit of a long shot but...
I have a job design here which uses a Switch stage which feeds a Join. The Switch and Join are both fed by datasets. On the Switch output, there are 18 links in all. We frequently get failures on this job, but it is not contention-related as I have tried running these one by one, in isolation, and furthermore, it doesn't seem to be volume-related as it happens equally on small and larger data volumes.
The error we see seems to actually relate to the Join stage (which takes in the 18 links from the Switch), namely:
"node_node1: Player 19 terminated unexpectedly"
"main_program: Unexpected termination by Unix signal 9(SIGKILL)"
Does anyone know if there is some kind of limit we should adhere to, when exiting data from a Switch or the number of links a Join can take as an input?
Multiple re-runs of these jobs do end successfully (usually after 3 or 4 attempts)
Cheers fellas