Sequential file stage - Number of readers per node
Posted: Tue Jan 15, 2013 3:00 am
Hi,
In Sequential file stage - Number of readers per node property is set to 2 and filter property is also used.
I am getting broken pipe issue and job is aborting when it is triggered with 15K data and no issue with less data.
Job design :
Sequentail file ---> Filter --->Column import ---> Target Db
Getting some warning at the filter property of the sequential file stage.
Warning message :
A filter can only be applied with multiple readers if the filter command is guaranteed to return the same number of bytes in the record for every record in the input file. If more or fewer bytes are returned the output dataset will contain duplicate or missing records
Director log:
Source subproc: tr: write error: Broken pipe
tr: write error
.
main_program: APT_PMsectionLeader(1, node1), player 4 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 5 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 7 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 8 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 9 - Unexpected exit status 1.
In Sequential file stage - Number of readers per node property is set to 2 and filter property is also used.
I am getting broken pipe issue and job is aborting when it is triggered with 15K data and no issue with less data.
Job design :
Sequentail file ---> Filter --->Column import ---> Target Db
Getting some warning at the filter property of the sequential file stage.
Warning message :
A filter can only be applied with multiple readers if the filter command is guaranteed to return the same number of bytes in the record for every record in the input file. If more or fewer bytes are returned the output dataset will contain duplicate or missing records
Director log:
Source subproc: tr: write error: Broken pipe
tr: write error
.
main_program: APT_PMsectionLeader(1, node1), player 4 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 5 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 7 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 8 - Unexpected exit status 1.
APT_PMsectionLeader(1, node1), player 9 - Unexpected exit status 1.