I have built a parallel job that contain FTP Plug-in stage, when the record count is less than 1000, it works well. But when it become larger, the following fatal message occur.
FTP_Plug_in_20,0: Failure during execution of operator logic
FTP_Plug_in_20,0: Fatal Error: Fatal: function 'ftp_put' failed
node_node1: Player 2 terminated unexpectedly.
repartition(0),1: Failure during execution of operator logic
repartition(0),1: Fatal Error: Unable to allocate communication resources
But do you have any specific reasons to use FTPStage, which cannot be addressed with simple OS level FTP? Did you check whether the ids have necessary permission\ directoty names are OK\ disk space exists?
- Sachin
benny.lbs wrote:I have built a parallel job that contain FTP Plug-in stage, when the record count is less than 1000, it works well. But when it become larger, the following fatal message occur.
FTP_Plug_in_20,0: Failure during execution of operator logic
FTP_Plug_in_20,0: Fatal Error: Fatal: function 'ftp_put' failed
node_node1: Player 2 terminated unexpectedly.
repartition(0),1: Failure during execution of operator logic
repartition(0),1: Fatal Error: Unable to allocate communication resources
Why I use ftp stage? because as you know, we can not edit a Dataset data (only can be viewed), so I want to transfer the DS file to PC in ASCII Text format, that I can edit the data to fulfill my testing cases. And then ftp back to AIX DS file.
sachinkc, both the permission and disk space are ok.
