Input Source for PX job - FTP vs Named pipes
Posted: Wed Dec 03, 2003 9:21 am
Hi,
I have a requirement to bring in a flat file from one of the mainframe machines to the Datastage ETL in Unix and use the file as input source for the ETL job. I am thinking to do this using an FTP process to bring the file across to ETL unix server and use it as the flat file input source.
But in this case I will need to wait till the FTP process is over. Is there a way other than FTP to read the data as and when it get through using some thing like named pipes? Does DataStage support this? What are the pros and cons for both these approaches?
Advise please.
I have a requirement to bring in a flat file from one of the mainframe machines to the Datastage ETL in Unix and use the file as input source for the ETL job. I am thinking to do this using an FTP process to bring the file across to ETL unix server and use it as the flat file input source.
But in this case I will need to wait till the FTP process is over. Is there a way other than FTP to read the data as and when it get through using some thing like named pipes? Does DataStage support this? What are the pros and cons for both these approaches?
Advise please.