NLS mapping error

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
kab123
Participant
Posts: 92
Joined: Tue May 18, 2004 4:05 pm

NLS mapping error

Post by kab123 »

Hi All,

Can I get any help how to suppress this warning error.
"nls_map_buffer_out() - NLS mapping error, row 12345 row =......"
I dont see this error for all jobs.. The jobs runs ok, but I dont want to see these warnings too..

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Please post the full text of one of these messages; otherwise it is impossible to diagnose whether it's important or not. It probably is; you've possibly lost some data because one or more characters could not be accurately mapped. When does this error occur? In the log, or only when you are using the data browser?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kab123
Participant
Posts: 92
Joined: Tue May 18, 2004 4:05 pm

Post by kab123 »

Ray,

JobName:.link.stagename:"nls_map_buffer_out() - NLS mapping error, row 12345 row = 'the whole record'..

The above given is the full message I could see..and this is seen in log and not when I view the data.. and I could see the same number of records loaded.. so i dont have any missing data...this error gives when i write to a file and when I read from same file it doesn't give any of these warnings..
I hope this info helps...Is this something need to do in NLS Tab in Seq file....:?:

Thanks Ray...
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Kab,

what is most likely happening is that you are getting an input character that has no corresponding output character in the destination NLS map. Can you tell us what your input and output sets & maps are? If you are dealing mainly with single-byte ascii type data, perhaps you could look at the row in question in an editor and see if any "funny" bytes show up - this would help localize the error cause. As Ray stated, you will most likely be losing these characters.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Are there any "?" characters in "the whole record" in the logged message? These are used to indicate which characters can not be mapped.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kab123
Participant
Posts: 92
Joined: Tue May 18, 2004 4:05 pm

Post by kab123 »

This is the actual log error...
I dont see any "?" in the record. but I am getting Null which is shown as "" in the log..It is unable to handle the nulls..do I need to set something at Default NULL String in the target seq file..?
nls_map_buffer_out() - NLS mapping error, row 16858 (approx), row = ""123456789","279522881","33645","05/17/1994","","ADAMS","PATRICIA"," "," ","MD","800 MIDLAND AVE"," ","MEMPHIS","TN","38123","9015457487","DEPT 150 PO BOX 300"," ","MEMPHIS","TN","381010357",,"HEMATOLOGY / ONCOLOGY","","","","",15"...

Thanks
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It's certainly worth a try.

You can set it for just that column; scroll to the right in the Columns grid of the Sequential File stage's Inputs tab Columns page to see how.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kab123
Participant
Posts: 92
Joined: Tue May 18, 2004 4:05 pm

Post by kab123 »

Ray,

Yes as u said, I could see "?" in the record...where I get nulls.
In my source file which is a comman delimited..doesn't have quotes..so, for nulls It is wrriten as "?"...And I get lot of such warnings...
but in the log, the warning is shown as :
nls_map_buffer_out() - NLS mapping error, row 75 (approx), row = "58-1972773,,,,3/1/2000,,A,G,,Healthcare Corporation of Northern California,,,,,,3160 Corporate Place,,Hayward,CA,94545,5107328800,,,Healthcare Corporation of Northern California,PO Box 74798,,Chicago,IL,60694-4798,9166148979,,,Home Infusion,,,,,,,,,, "

Any suggestions..

thanks
kab123
Participant
Posts: 92
Joined: Tue May 18, 2004 4:05 pm

Post by kab123 »

Nulls are not read properly and write as nulls...
how to handle nulls properly..?
kab123
Participant
Posts: 92
Joined: Tue May 18, 2004 4:05 pm

Post by kab123 »

only some Nulls are not readable and inturn they are written as "?" in the tgt fil.....but not always all nulls are written as "?".
How to handle this NLS mapping warnings..? :(

Any help pls...

Thanks in Advance
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

kab123,

if, in some rows, NULLs are handled correctly and in others they aren't then it would be logical to assume that they are not the same character, even though they appear to be. NULL is mapped in just every character set and mapping that I know of.

Can you put a second output link to your transformer and output that one row you are getting from a derivation of

Code: Select all

SEQ(In.ColumnName)
? Then look that character up in your ASCII table or tell us what the value is? Plus tell us what your NLS character set is for the job or column in question?
Post Reply