UCS-2

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Scope
Premium Member
Premium Member
Posts: 63
Joined: Wed Jun 06, 2007 6:38 am
Location: Chennai

UCS-2

Post by Scope »

hai,

whether datastage accept 'UCS-2' File Format.
Kumarez
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Yes, USC2 is almost identical to UTF-16 and if you have characters that are not mapped as you expect then you can always create your own mapping tables.
Scope
Premium Member
Premium Member
Posts: 63
Joined: Wed Jun 06, 2007 6:38 am
Location: Chennai

UCS-2

Post by Scope »

Thanks AndrW.

We have to Load Chinese Character to target. do you know whether chinese character support this format.
Kumarez
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Any UTF is an encoding of Unicode which is an international convention for encoding every character that might be encountered anywhere in commercial data processing. Including Chinese characters, both simplified and traditional.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

2ksaint - you need to tell DataStage the correct encoding that is being used by the file.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

2ksaint - you have to specify in your job that the file you are reading is using UNICODE, not UTF-8. Specify this in the NLS tab on the sequential file stage.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Don't trust the "view data" to correctly display the Chinese characters. Write the data to a text file and use a viewing tool that you know will display Chinese correctly.
2ksaint
Participant
Posts: 66
Joined: Sun Jan 20, 2008 11:15 pm

Post by 2ksaint »

thanks Arndw,

Once importing the meta data, all the columns become a single column and the characters changes to ? or 0

So there is no point on viewing the data as the meta data itself not loaded
2ksaint
Participant
Posts: 66
Joined: Sun Jan 20, 2008 11:15 pm

Post by 2ksaint »

I would also like to inform that when i try to start the DS service im getting the following NLS maps:

Checking NLS locale OFF
Checking NLS locale DEFAULT
Checking NLS locale GB-ENGLISH
Checking NLS locale US-ENGLISH
Checking NLS locale AU-ENGLISH
Checking NLS locale CA-ENGLISH
Checking NLS locale IE-ENGLISH
Checking NLS locale NZ-ENGLISH
Checking NLS locale ZA-ENGLISH
Loading NLS map file UNICODE
Loading NLS map file UTF8
Loading NLS map file ASCII
Loading NLS map file ISO8859-1
Loading NLS map file ISO8859-1+MARKS
Loading NLS map file MNEMONICS
Loading NLS map file MS936-CS
Loading NLS map file MS1252-CS
Loading NLS map file ISO8859-1-CS
Loading NLS map file ISO8859-15-CS
Loading NLS map file ASCII+MARKS
Loading NLS map file MS1252
Loading NLS map file MS1252+MARKS
.
.
.
JobMonApp has been started.

I would like to know whether the "Checking NLS locale" refering Datastage NLS package or AIX os

Because i dont find any chinese NLS maps.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Then you need to use the Administrator client to build the Chinese map(s) that you require (probably BIG5 or GB2312, but also build the map of the same name but with a "-CS" suffix, which is used for communicating with your DataStage client). This only needs to be done once.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
2ksaint
Participant
Posts: 66
Joined: Sun Jan 20, 2008 11:15 pm

Post by 2ksaint »

Thanks ray.

Kindly tell me on how to build Chinese maps, as im not able to view the build option in Administrator NLS.

Which file has to be created or edited?

Is that configuration has to be added to dsenv or uvconfig file?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

The National Language Support Guide has a whole chapter titled "Creating new maps"
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

If you can't view all maps, you can't build them either. You need to be the DataStage Administrator.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
2ksaint
Participant
Posts: 66
Joined: Sun Jan 20, 2008 11:15 pm

Post by 2ksaint »

Thanks Arndw, Ray.

As im datastage administrator, im creating the new maps,

But im not so sure on creating it, so anyone please share some dsenv configuration aswell as created map for any foriegn language, so that i can be so sure in altering files in the server.

i have zh_CN - chinese as well as GB2312 fonts installed on AIX server.

Please help in configuring / creating the maps.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There is already a GB2312 series of maps provided with DataStage. Choose the Show All Maps option in Administrator client.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply