Euro Symbol in Datastage

[karthi_gana]

Datastage Settings:

Project default (ISO_8859-1:1987)


Unix Settings:

$ locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=

[karthi_gana]

Any Inputs ?

[chulett]

You don't have a DataStage problem, at least not yet, so technically not something that should have been posted here.

Fix the "some code page issue" in Step 1 so your data remains intact. Perhaps the Business User will need to use a binary transfer.

[ArndW]

You will need to specify the correct code page on the mainframe FTP. Unless you can force this FTP to be in "binary" mode, then your file will have the original EBCDIC character encoding. But what is happening is that the FTP is doing an automatic code page conversion from EBCDIC to the default ASCII character set for that machine, which evidently doesn't know about the Euro symbol. Specify the correct character set in that FTP session and your mapping issues will be solved.

[chulett]

I wondered about that. Seems to me the original transfer by 'the business user' to the mainframe is the one that would be doing the ASCII to EBCDIC conversion. And it sounds like the 'corruption' is happening on that initial step. From what I recall, a simple FTP script to get the file onto the UNIX server from the mainframe (step 3) won't be able to do a conversion back to ASCII so wondering exactly what utilities are involved here.

Regardless, as noted - specify the correct code page.

[ray.wurlod]

I'm not at a DataStage machine at the moment, but I seem to recall there's a parameter in uvconfig relating to handling of the Euro character.

[chulett]

Seems to me that Ray is not mentioning something that will solve your current problem but rather something you may need to look into once you do.

(but then The Mind Of The Ray can be an inscrutable thing at times)

[karthi_gana]

Ok. I Will try and get back to you.

But the same is displaying as '?' in datastage. When it loaded into Teradata through datastage it is showing some junk character.

where is the issue? It is really tricky for me to identify.

Mainframe? or Unix? or Datastage ? or Database ?

[karthi_gana]

This issue has been resolved for now by changing euro symbol to "Euro" text.