Page 1 of 2

UCS-2

Posted: Tue Mar 18, 2008 1:48 am
by Scope
hai,

whether datastage accept 'UCS-2' File Format.

Posted: Tue Mar 18, 2008 1:59 am
by ArndW
Yes, USC2 is almost identical to UTF-16 and if you have characters that are not mapped as you expect then you can always create your own mapping tables.

UCS-2

Posted: Tue Mar 18, 2008 5:15 am
by Scope
Thanks AndrW.

We have to Load Chinese Character to target. do you know whether chinese character support this format.

Posted: Tue Mar 18, 2008 5:41 am
by ray.wurlod
Any UTF is an encoding of Unicode which is an international convention for encoding every character that might be encountered anywhere in commercial data processing. Including Chinese characters, both simplified and traditional.

Posted: Tue Mar 18, 2008 7:23 am
by ArndW
2ksaint - you need to tell DataStage the correct encoding that is being used by the file.

Posted: Wed Mar 19, 2008 2:04 am
by ArndW
2ksaint - you have to specify in your job that the file you are reading is using UNICODE, not UTF-8. Specify this in the NLS tab on the sequential file stage.

Posted: Wed Mar 19, 2008 7:57 am
by ArndW
Don't trust the "view data" to correctly display the Chinese characters. Write the data to a text file and use a viewing tool that you know will display Chinese correctly.

Posted: Wed Mar 19, 2008 8:22 am
by 2ksaint
thanks Arndw,

Once importing the meta data, all the columns become a single column and the characters changes to ? or 0

So there is no point on viewing the data as the meta data itself not loaded

Posted: Wed Mar 19, 2008 9:00 am
by 2ksaint
I would also like to inform that when i try to start the DS service im getting the following NLS maps:

Checking NLS locale OFF
Checking NLS locale DEFAULT
Checking NLS locale GB-ENGLISH
Checking NLS locale US-ENGLISH
Checking NLS locale AU-ENGLISH
Checking NLS locale CA-ENGLISH
Checking NLS locale IE-ENGLISH
Checking NLS locale NZ-ENGLISH
Checking NLS locale ZA-ENGLISH
Loading NLS map file UNICODE
Loading NLS map file UTF8
Loading NLS map file ASCII
Loading NLS map file ISO8859-1
Loading NLS map file ISO8859-1+MARKS
Loading NLS map file MNEMONICS
Loading NLS map file MS936-CS
Loading NLS map file MS1252-CS
Loading NLS map file ISO8859-1-CS
Loading NLS map file ISO8859-15-CS
Loading NLS map file ASCII+MARKS
Loading NLS map file MS1252
Loading NLS map file MS1252+MARKS
.
.
.
JobMonApp has been started.

I would like to know whether the "Checking NLS locale" refering Datastage NLS package or AIX os

Because i dont find any chinese NLS maps.

Posted: Wed Mar 19, 2008 5:22 pm
by ray.wurlod
Then you need to use the Administrator client to build the Chinese map(s) that you require (probably BIG5 or GB2312, but also build the map of the same name but with a "-CS" suffix, which is used for communicating with your DataStage client). This only needs to be done once.

Posted: Thu Mar 20, 2008 5:46 am
by 2ksaint
Thanks ray.

Kindly tell me on how to build Chinese maps, as im not able to view the build option in Administrator NLS.

Which file has to be created or edited?

Is that configuration has to be added to dsenv or uvconfig file?

Posted: Thu Mar 20, 2008 5:49 am
by ArndW
The National Language Support Guide has a whole chapter titled "Creating new maps"

Posted: Thu Mar 20, 2008 8:04 am
by ray.wurlod
If you can't view all maps, you can't build them either. You need to be the DataStage Administrator.

Posted: Thu Mar 20, 2008 9:39 am
by 2ksaint
Thanks Arndw, Ray.

As im datastage administrator, im creating the new maps,

But im not so sure on creating it, so anyone please share some dsenv configuration aswell as created map for any foriegn language, so that i can be so sure in altering files in the server.

i have zh_CN - chinese as well as GB2312 fonts installed on AIX server.

Please help in configuring / creating the maps.

Posted: Thu Mar 20, 2008 5:05 pm
by ray.wurlod
There is already a GB2312 series of maps provided with DataStage. Choose the Show All Maps option in Administrator client.