I have a job where source is ODBC Connector stage(Sql Server) and target is sequential file. I need to generate the file and data is around 4GB. This file will be used by downstream system.
My job is working fine for sometime but later it is aborting with below error message:-
Code: Select all
SendWriteSignal() failed on node etldev01 ds=0 conspat=1 Broken pipe
Write to dataset onj [fd 17] failed (Error 0) on node node1.hostname etldev01
Block write failure. Partition:1
Here I am worried why we had to increase the paging space on our server,are we holding the data and it is going our of memory.
Later I tried with adding parameter APT_BUFFER_FLUSH_COUNT=10000 env veriable to job. But still I am getting same error.
Can anyone help me to understand why exactly I am facing this issue.