Extracting data from a File in the Mainframe system
Posted: Thu Mar 01, 2007 3:23 pm
Hi,
We are working in DS 7.1 version Server Job and the server OS in Windows.
We have a scenario where we need to read a hugh file from the Mainframe system and then process it.
- We cannot use a CFF stage to read this Mainframe file as it is in a remote Mainframe machine. So, we have use a FTP stage to fetch it from a remote machine.
- But what is the metadata that we need use in the FTP stage. We have the Cobol copybook of the Mainframe file that we need to fetch. But the copybook imported metadata has 'Level number' attribute for each column and so this metadata cannot be used in a FTP stage. It can be used only in a CFF stage.
- The file that we need to process is very huge (about 40 million records). So we didn't want to transfer it to DS server and then do the processing.
Please give us your thoughts on how we could proceed in this scenario.
Those who have worked on reading files directly from a Mainframe system, please share your experience on how you acheived this.
Thank you.
We are working in DS 7.1 version Server Job and the server OS in Windows.
We have a scenario where we need to read a hugh file from the Mainframe system and then process it.
- We cannot use a CFF stage to read this Mainframe file as it is in a remote Mainframe machine. So, we have use a FTP stage to fetch it from a remote machine.
- But what is the metadata that we need use in the FTP stage. We have the Cobol copybook of the Mainframe file that we need to fetch. But the copybook imported metadata has 'Level number' attribute for each column and so this metadata cannot be used in a FTP stage. It can be used only in a CFF stage.
- The file that we need to process is very huge (about 40 million records). So we didn't want to transfer it to DS server and then do the processing.
Please give us your thoughts on how we could proceed in this scenario.
Those who have worked on reading files directly from a Mainframe system, please share your experience on how you acheived this.
Thank you.