Junk character in sequential file viewer stage
Posted: Fri Dec 14, 2018 8:36 am
Hi All,
I am reading a cobol EBCDIC file using CFF stage and loading it into Sequential file stage. There are 2 fields defined in CFF as PICX(2) and PIC X(1) which is in Record Layout shown as CHARCTER 2 and CHARACTER 1 respectively.
I directly mapped those 2 fields to sequential file stage using datatype Char(2) and CHAR(1).
Some data are shown in the datastage file viewer for the field with 2 charadters as
The second character is | like but I can not copy it as when I am pasting only ? is pasted.
I used String to Raw function to display it and I got the following
Are these CAN and Linefeed in HEX? How do I remove them ? When I see it in Unix, it shows noting....
The column has 2 distinct Values when I putput in Unix
RE and blank.
I use dthe following commnd to deisplay in hexdump:
How can I convert these foreign characters to space?
I am reading a cobol EBCDIC file using CFF stage and loading it into Sequential file stage. There are 2 fields defined in CFF as PICX(2) and PIC X(1) which is in Record Layout shown as CHARCTER 2 and CHARACTER 1 respectively.
I directly mapped those 2 fields to sequential file stage using datatype Char(2) and CHAR(1).
Some data are shown in the datastage file viewer for the field with 2 charadters as
Code: Select all
?|
I used String to Raw function to display it and I got the following
Code: Select all
{1a 18}
The column has 2 distinct Values when I putput in Unix
RE and blank.
I use dthe following commnd to deisplay in hexdump:
Code: Select all
-bash-4.2$ cat RDTDP.txt|cut -d'|' -f1|sort|uniq|hexdump
0000000 181a 1a0a 0a1a 4552 000a
0000009