We have DataStage 7.5.2 in production and want to upgrade to version 8.0.
Here is how we handle mainframe flat files in 7.5.2 using 2 jobs where we have to convert any EBCDIC characters into ASCII equivalent.
(1) Job 1 : FTP plugin > TRN>Sequential File (FTP type is binary)
(2) Job 2 : CFF Stage > Any Target
Example:
Job 1 :
If we have a mainframe flat file with 6 columns totalling 130 characeters we simply download the complete row in binary format. We don't define each column in FTP stage in STEP 1. That we way we download the mainframe file ASIS from mainframe to ETL Server in binary format.
Job 2 :
Then in second job we use the sequential file as source and using CFF Stage we import the CFD and apply against the the sequential file that we had FTP'd in Job 1. Target can be anything, another file or table.This process work flawlessly in parallel job and we don't have to do any manual conversion column by column.
Question
(1)
The above is a 2 step process in 7.5.2. Has anyone been able to process mainframe flat files in ONE STEP only in VERSION 8.0?
(2)
Can we even process a mainframe file in just 1 step in VERSION 8.0 and successfully decode all EBCDIC characeters? If yes, please let me know what were the STEPS involved?
Converting Mainframe Files with EBCDIC into ASCII
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 71
- Joined: Mon Jul 09, 2007 1:12 pm
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 145
- Joined: Fri Sep 21, 2007 9:35 am
- Location: Boston
I am not sure whether this can be called one step process but I usually process
1) a simple mainframe flat file ( without any comp fields, arrays and redefines by the following steps
ftp ---> transform ----> load
2) a complex file from Mainframe (ftp the file to DataStage server from Mainframe directly) then use
cff ----> transform -----> Load
1) a simple mainframe flat file ( without any comp fields, arrays and redefines by the following steps
ftp ---> transform ----> load
2) a complex file from Mainframe (ftp the file to DataStage server from Mainframe directly) then use
cff ----> transform -----> Load
-
- Premium Member
- Posts: 145
- Joined: Fri Sep 21, 2007 9:35 am
- Location: Boston
I am not sure whether this can be called one step process but I usually process
1) a simple mainframe flat file ( without any comp fields, arrays and redefines by the following steps
ftp ---> transform ----> load
2) a complex file from Mainframe (ftp the file to DataStage server from Mainframe directly) then use
cff ----> transform -----> Load
1) a simple mainframe flat file ( without any comp fields, arrays and redefines by the following steps
ftp ---> transform ----> load
2) a complex file from Mainframe (ftp the file to DataStage server from Mainframe directly) then use
cff ----> transform -----> Load