special characters handling
Posted: Mon Dec 28, 2009 8:10 pm
Hello
I have an issue while processing data from a file. Iam using seq file stage as source and i need to produce fixed width file so i am using seq file stage as target too.The file is fixed width (310 byte size) and i have file layout which specifies each and every field length. While i was trying to process the file using the seq file stage i encountered some East european data which has special character é in one record which altered the record length to 311 bytes beacuse of which my job failed as i am doing some string to time stamp conversion on one of the field. In datastage admin the parallel locale has been set as UTF-8 and stage NLS-Map is Project Default (UTF-8). I tried with ISO-8859-1 also. We can expect such type of characters in future. I even tried by specifying unicode under the extended properties in the columns tab of the sequential file which i am using to read the input file.
Am i missing some thing. Please assit me in how to handle these type of special characters.
I have an issue while processing data from a file. Iam using seq file stage as source and i need to produce fixed width file so i am using seq file stage as target too.The file is fixed width (310 byte size) and i have file layout which specifies each and every field length. While i was trying to process the file using the seq file stage i encountered some East european data which has special character é in one record which altered the record length to 311 bytes beacuse of which my job failed as i am doing some string to time stamp conversion on one of the field. In datastage admin the parallel locale has been set as UTF-8 and stage NLS-Map is Project Default (UTF-8). I tried with ISO-8859-1 also. We can expect such type of characters in future. I even tried by specifying unicode under the extended properties in the columns tab of the sequential file which i am using to read the input file.
Am i missing some thing. Please assit me in how to handle these type of special characters.