EBCIDI file split in SE
Posted: Thu May 06, 2010 11:35 am
I have one Binary file that contains multiple layout coming from mainframe. First few colums in all layout are same, rest are not. We can differentiate between different layouts from 'TXN_Type' colum.
'TXN_Type' is TXN## (FIELD 3) in following example.
All 20s,40s,50s have same Layout respectively.
sample file
FIELD 1, FIELD 2, TXN20, FIELD 4, FIELD 5
FIELD 1, FIELD 2, TXN21, FIELD 4, FIELD 5
FIELD 1, FIELD 2, TXN22, FIELD 4, FIELD 5
FIELD 1, FIELD 2, TXN40, FIELD 4
FIELD 1, FIELD 2, TXN42, FIELD 4
FIELD 1, FIELD 2, TXN50, FIELD 4, FIELD 5, FIELD 6
FIELD 1, FIELD 2, TXN52, FIELD 4, FIELD 5, FIELD 6
FIELD 1, FIELD 2, TXN51, FIELD 4, FIELD 5, FIELD 6
Options I have (as far as my knowledge goes):
1) I can split the file on Mainframe into seperate file based on Transaction Type 20s and 40s... and copy one by one to the DS SE Server. VERDICT: Not desriable since volume is under 25k
2) I prefer to copy the whole file to DS SE and then use DS split Job to split the file based on TXN_Type. Since 'ID Field' 'Value' under 'Selection Criteria' tab of CFF stage only pick one layout not all 20s and so on. VERDICT: best way to move forward.
In EE we can read EBCIDIC file in Sequential file stage, read only one colum e.g. TXN_TYPE, and leave the rest as is and split the file but please let me know how can I do this in SE.
I have tried searching but EE solutions came up...feel free to show me if you found one... thanks in advance...
'TXN_Type' is TXN## (FIELD 3) in following example.
All 20s,40s,50s have same Layout respectively.
sample file
FIELD 1, FIELD 2, TXN20, FIELD 4, FIELD 5
FIELD 1, FIELD 2, TXN21, FIELD 4, FIELD 5
FIELD 1, FIELD 2, TXN22, FIELD 4, FIELD 5
FIELD 1, FIELD 2, TXN40, FIELD 4
FIELD 1, FIELD 2, TXN42, FIELD 4
FIELD 1, FIELD 2, TXN50, FIELD 4, FIELD 5, FIELD 6
FIELD 1, FIELD 2, TXN52, FIELD 4, FIELD 5, FIELD 6
FIELD 1, FIELD 2, TXN51, FIELD 4, FIELD 5, FIELD 6
Options I have (as far as my knowledge goes):
1) I can split the file on Mainframe into seperate file based on Transaction Type 20s and 40s... and copy one by one to the DS SE Server. VERDICT: Not desriable since volume is under 25k
2) I prefer to copy the whole file to DS SE and then use DS split Job to split the file based on TXN_Type. Since 'ID Field' 'Value' under 'Selection Criteria' tab of CFF stage only pick one layout not all 20s and so on. VERDICT: best way to move forward.
In EE we can read EBCIDIC file in Sequential file stage, read only one colum e.g. TXN_TYPE, and leave the rest as is and split the file but please let me know how can I do this in SE.
I have tried searching but EE solutions came up...feel free to show me if you found one... thanks in advance...