One complex mainframe flat file -- many columns -- read/spli
Posted: Wed Mar 08, 2006 2:47 pm
Hi,
I would appreciate some ideas in this...
Information I have
1) One mainframe flat file in EBCDIC format with account and transaction information. Binary FTPed to the ETL Server from Mainframe.
2) Five cobol copy books (including the Header/Trailer copy book)
3) There are too many columns in each copy book (approx 800)
Challenges:
I would like to design a PX job where I would have to read this one huge EBCDIC file (with approx 2500 columns), convert it into ASCII and split the file based on record type.
The copy book that I have has 02 item level and not 01 level. My understanding is that DataStage CANNOT import CFDs with 02 level. When I changed it to 01 in the Copy book, I was able to import all the copy books..
Later I dropped all the individual CFDs on to the same output link from CFF stage. Since there is one file, I am not sure reading the 2500 is a good option.
Please advice if there is any other option..
Thank You
I would appreciate some ideas in this...
Information I have
1) One mainframe flat file in EBCDIC format with account and transaction information. Binary FTPed to the ETL Server from Mainframe.
2) Five cobol copy books (including the Header/Trailer copy book)
3) There are too many columns in each copy book (approx 800)
Challenges:
I would like to design a PX job where I would have to read this one huge EBCDIC file (with approx 2500 columns), convert it into ASCII and split the file based on record type.
The copy book that I have has 02 item level and not 01 level. My understanding is that DataStage CANNOT import CFDs with 02 level. When I changed it to 01 in the Copy book, I was able to import all the copy books..
Later I dropped all the individual CFDs on to the same output link from CFF stage. Since there is one file, I am not sure reading the 2500 is a good option.
Please advice if there is any other option..
Thank You