Page 1 of 1
Re: Euro Symbol in Datastage
Posted: Tue Sep 29, 2015 3:46 am
by karthi_gana
Datastage Settings:
Project default (ISO_8859-1:1987)
Unix Settings:
$ locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=
Re: Euro Symbol in Datastage
Posted: Tue Sep 29, 2015 10:48 pm
by karthi_gana
Any Inputs ?
Posted: Wed Sep 30, 2015 7:11 am
by chulett
You don't have a DataStage problem, at least not yet, so technically not something that should have been posted here.
Fix the "some code page issue" in Step 1 so your data remains intact. Perhaps the Business User will need to use a binary transfer.
Posted: Wed Sep 30, 2015 9:21 am
by ArndW
You will need to specify the correct code page on the mainframe FTP. Unless you can force this FTP to be in "binary" mode, then your file will have the original EBCDIC character encoding. But what is happening is that the FTP is doing an automatic code page conversion from EBCDIC to the default ASCII character set for that machine, which evidently doesn't know about the Euro symbol. Specify the correct character set in that FTP session and your mapping issues will be solved.
Posted: Wed Sep 30, 2015 9:33 am
by chulett
I wondered about that. Seems to me the original transfer by 'the business user' to the mainframe is the one that would be doing the ASCII to EBCDIC conversion. And it sounds like the 'corruption' is happening on that initial step. From what I recall, a simple FTP script to get the file onto the UNIX server from the mainframe (step 3) won't be able to do a conversion back to ASCII so wondering exactly what utilities are involved here.
Regardless, as noted - specify the correct code page.
Posted: Wed Sep 30, 2015 4:44 pm
by ray.wurlod
I'm not at a DataStage machine at the moment, but I seem to recall there's a parameter in uvconfig relating to handling of the Euro character.
Posted: Thu Oct 01, 2015 7:45 am
by chulett
Seems to me that Ray is not mentioning something that will solve your current problem but rather something you may need to look into once you do.
(but then The Mind Of The Ray can be an inscrutable thing at times)
Posted: Thu Oct 22, 2015 8:52 am
by karthi_gana
Ok. I Will try and get back to you.
But the same is displaying as '?' in datastage. When it loaded into Teradata through datastage it is showing some junk character.
where is the issue? It is really tricky for me to identify.
Mainframe? or Unix? or Datastage ? or Database ?
Posted: Wed Oct 28, 2015 8:31 am
by karthi_gana
This issue has been resolved for now by changing euro symbol to "Euro" text.