Prblems with polish character
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 13
- Joined: Fri Aug 11, 2006 11:57 am
- Location: Toulouse, France
The NLS_LANG setting is not UTF-8 because it caters to data from other geographies.
Isn't there some way in Datastage by which we can load data into a target table in the desired character format irespective of the existing map.
Basically I am interested to know if there is anything which is possible within datastage.
Isn't there some way in Datastage by which we can load data into a target table in the desired character format irespective of the existing map.
Basically I am interested to know if there is anything which is possible within datastage.
Cheers
Soumbeet
Soumbeet
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
DataStage with NLS enabled only uses its own, idiosyncratic encoding of Unicode internally, and therefore every interface to the "outside world" must have an appropriate character map. Typically the UNIX maps and the Windows map (for connection to the clients) will have different names for the same thing, for example ISO8859-1 on UNIX and MS1252 on Windows.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Re: Prblems with polish character
This is specific to your NLS_LANG setting on your PC not DataStage. The DataStage setting will only be used when the job runs.soumbeet wrote:The problem that I am facing is, when I view data in datastage for the sequential file , the output is weird (it has special characters like ?).
I'm not familiar with an NLS enabled DataStage install, but this is what I would do if it wasn't. Not sure if it will help or not. You need to tell Oracle what the character set is you are loading and - if it is different from the database character set - it will attempt to convert things during the operation. Note that not all characters from X will fit in Y so your mileage may vary.
Do this by setting a User Defined Environment Variable for NLS_LANG in the Administrator for the project. Set its value to $ENV which will ensure it stays at the currently set value. Then, add the parameter in your loading job and override the default value there to UTF-8, which would be AMERICAN_AMERICA.UTF8 I believe. Perhaps something else for you, check with your DBA. I've also found you need to do the same for LC_CTYPE and override it in the job to C.utf8 as well.
This will set these values for just this job and tell Oracle what it needs to do conversion-wise. As I said, I have no idea if this is proper for an NSL enabled installation, others will have to chime in on that. All I can say is it works for me - not specifically for Polish characters but others. Perhaps it will give you some ideas or help someone else.
![Idea :idea:](./images/smilies/icon_idea.gif)
![Evil or Very Mad :evil:](./images/smilies/icon_evil.gif)
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers