Can you try it using the ISO8859-1 map?
It is the first character in your data that is giving the problem - the "?" is an indicator of "unmappable character". In hex it is 0xC9. The next two characters (0x4B and 0x4F) are being mapped as "K" and "O" respectively, which is correct.
0xC9 is 201 in Decimal - see if you can find a listing of "ASCII" codes that goes all the way up to 255 to determine what this character (Char(201)) should be.
Q1LPRD is a space filled field.
AS400/flat file sources, NLS, UTF8 & a new NLS-related e
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 40
- Joined: Thu Mar 30, 2006 6:30 am
- Location: Near Geneva, Switzerland
- Contact:
In fact, I already did that, and testing seems to indicate it is working.
You better be careful, Ray. People might start to think you know your stuff.
Thanks
Wade
You better be careful, Ray. People might start to think you know your stuff.
![Laughing :lol:](./images/smilies/icon_lol.gif)
Thanks
Wade
Last edited by wwalker on Wed Apr 09, 2008 6:09 am, edited 1 time in total.
Wade Walker
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
MNEMONICS is a pseudo map that recognizes "ASCII representations" such as <N?>.
You may find MNEMONICS-1 even better, as it recognizes "ISO885901" representations such as <o>> (LATIN SMALL LETTER O WITH CIRCUMFLEX).
You may find MNEMONICS-1 even better, as it recognizes "ISO885901" representations such as <o>> (LATIN SMALL LETTER O WITH CIRCUMFLEX).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 40
- Joined: Thu Mar 30, 2006 6:30 am
- Location: Near Geneva, Switzerland
- Contact:
Ray,
Interesting observation about MNEMONIC-1...but how would one get their flippers on that character set if they do not have it..
Is it just a matter of installing it onto the NLS server?
..and if I understand fully, NMEMONIC-1 would be considered a superset of ISO8859-1 and UTF8 ? By using this I should then resolve my issue of character sets for the French Market?
...and, in the interest of exposing my NLS ignorance further, isn't the UNICODE character set the one to use to avoid this issue, when using the DS processes in multiple markets, such as in my current project? or, what would be the best/most practical choice for character set, since we are already using NLS?
I seem to recall using UNICODE (or was it UTF8??) when I moved a process built for the Italian market to the Japanese market for a different client....
Thanks for your help.
W
Interesting observation about MNEMONIC-1...but how would one get their flippers on that character set if they do not have it..
Is it just a matter of installing it onto the NLS server?
..and if I understand fully, NMEMONIC-1 would be considered a superset of ISO8859-1 and UTF8 ? By using this I should then resolve my issue of character sets for the French Market?
...and, in the interest of exposing my NLS ignorance further, isn't the UNICODE character set the one to use to avoid this issue, when using the DS processes in multiple markets, such as in my current project? or, what would be the best/most practical choice for character set, since we are already using NLS?
I seem to recall using UNICODE (or was it UTF8??) when I moved a process built for the Italian market to the Japanese market for a different client....
Thanks for your help.
W
Wade Walker
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Ultimately - and particularly in Japan where there are many different encodings of characters - you need to know how the character set is encoded. ASCII and ISO8859-x are "single byte character sets" so it should be a simple matter of reviewing which map(s) handle all the character in your data.
The maps convert the external data characters into an idiosyncratic "UV-UTF8" encoding for use within DataStage, and back again as they leave DataStage.
(Note that parallel jobs use a newer, different mechanism.)
The maps convert the external data characters into an idiosyncratic "UV-UTF8" encoding for use within DataStage, and back again as they leave DataStage.
(Note that parallel jobs use a newer, different mechanism.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.