Problem with International Characters

ray.wurlod · Post by **ray.wurlod** » Tue May 06, 2008 3:55 pm

Welcome aboard. DataStage will quite happily handle such characters, indeed all characters in common use in business data processing.

But you must be aware of how they are encoded. When you import the table definition, do you specify any particular map, for example UTF-8 ? (I am assuming here that you have NLS enabled.) Do the columns import as VarChar or NVarChar ?

Minhajuddin · Post by **Minhajuddin** » Tue May 06, 2008 8:51 pm

You need to ask your architects about the code page for NLS (e.g. Windows-1252). And then you need to change the NLS settings in datastage, you can make these changes on the job level or the project level.

But be aware that NLS is not supported on Datastage 7.5x2

Sampy · Post by **Sampy** » Wed May 07, 2008 9:07 am

Apologies , I meant to say - Thank you Minhajuddin

Minhajuddin · Post by **Minhajuddin** » Wed May 07, 2008 9:39 am

You can't just select a code page which works for a set of data.
You need to ask this question to the guys who give you the data, You need to ask them how the data is encoded.

ArndW · Post by **ArndW** » Sat May 10, 2008 3:04 am

[quote="veera24... Before, make sure that there is no '?' symbol in it because I've faced the same problem long back. usually UTF8 wont support other usual symbols....[/quote] I've never had probems with other usual symbols and the Question mark character is definately supported in UTF8. Could you explain what you mean?

veera24 · Post by **veera24** » Sat May 10, 2008 11:46 pm

ArndW wrote:[quote="veera24... Before, make sure that there is no '?' symbol in it because I've faced the same problem long back. usually UTF8 wont support other usual symbols....

I've never had probems with other usual symbols and the Question mark character is definately supported in UTF8. Could you explain what you mean?[/quote]
I had end up with a problem as i stated. I got the fatal error as "Abnormal Termination error cos of NLS".
I thot it might be the problem of NLS setting...If not could you explain the log which i got..
Thanks...

veera24 · Post by **veera24** » Sat May 10, 2008 11:47 pm

ArndW wrote:[quote="veera24... Before, make sure that there is no '?' symbol in it because I've faced the same problem long back. usually UTF8 wont support other usual symbols....

I've never had probems with other usual symbols and the Question mark character is definately supported in UTF8. Could you explain what you mean?[/quote]
I had end up with a problem as i stated. I got the fatal error as "Abnormal Termination error cos of NLS".
I thot it might be the problem of NLS setting...If not could you explain the log which i got..
Thanks...

ArndW · Post by **ArndW** » Sun May 11, 2008 4:31 am

veera24 - I can't explain your log contents since I don't know what they are. Note that the client software often displays characters that it cannot display correctly as a "?" question mark; you need to differentiate between an actual question-mark and a non-displayable character. I seriously doubt that any character set in DataStage has an issue with a real question mark (ASCII character 0x3F)

chulett · Post by **chulett** » Sun May 11, 2008 7:32 am

veera24 wrote:I got the fatal error as "Abnormal Termination error cos of NLS".

I doubt any error message uses "cos". You'd need to post the complete / unedited log message for anyone to provide proper help.

ray.wurlod · Post by **ray.wurlod** » Sun May 11, 2008 4:51 pm

As well as being the accepted abbreviation for cosine, "cos" is also a kind of lettuce. There is a COS (cosine) function available in DataStage, but it is a numeric function and therefore probably would not be affected by NLS settings.