NLS Problem?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
sibysjoseph
Participant
Posts: 19
Joined: Fri Oct 07, 2005 1:19 am
Location: india

NLS Problem?

Post by sibysjoseph »

HI All,
There seems to be a new problem while running the jobs. ONce the job is completed and while investigating the director log events i have found the warning as follows ..

Program "DSR_GETJOB": Line 50, Index d:/datastage/Projects/EMAP_TEST/I_DS_JOBS/INDEX.000 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index d:/datastage/Projects/EMAP_TEST/I_DS_JOBS/INDEX.001 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index d:/datastage/Projects/EMAP_TEST/I_DS_JOBS/INDEX.002 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index d:/datastage/Projects/EMAP_TEST/I_DS_JOBS/INDEX.003 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
DataStage Job 134 Phantom 8632
Program "DSR_GETPROP": Line 63, Index d:/datastage/Projects/EMAP_TEST/I_DS_STAGETYPES/INDEX.000 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
Program "DSR_GETPROP": Line 63, Index d:/datastage/Projects/EMAP_TEST/I_DS_STAGETYPES/INDEX.001 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
Program "DSR_GETPROP": Line 63, Index d:/datastage/Projects/EMAP_TEST/I_DS_STAGETYPES/INDEX.002 is configured to use a NLS locale (US-ENGLISH) for collation. NLS is not currently enabled on this system.
DataStage Phantom Finished

As far as i know NLS is not being enabled for this project and this warning was not present the previously ? SO wy does this warning appears?
can u guys throw some insight into tis ?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Has NLS ever been enabled? Not "as far as I know" - please check. Execute the command $DSHOME/bin/analyze.shm -t0 | grep NLS to see whether it's currently enabled, and grep NLS $DSHOME/*uvconfig* to see whether it's ever been enabled.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
MTA
Participant
Posts: 37
Joined: Thu Feb 02, 2006 2:25 pm

NLS issue with multibite greek charector

Post by MTA »

Hi,
We are facing very strange problem with out greek charector file.

Any input of yours would be greatly appreciated.

Environment:
Datastage 7.5.1 installed on solaris
Database : DB2 8.2 installed on AIX . (UTF 8)
Job Type: Parallel.

we have successfully loaded greek data to one of our tables USING datastage file read as UTF 8 and UNICODE.we are able to view the data correcty through command line with is set to UTF8. We have a JAVA application that usesthis data for our users ( UTF8 ) but when we view the data from the java application its all junk.

But when i load the same file using code page 1028 this time using a db2 load script i am able to see the data through command line with is set to UTF8 and also through our Java application and its perfect. I want to understand what can be the difference while loading the same file through Datastage and load scripts since for both the NLS is set to UTF8.

We got the Hex value for one of the records when loaded through datastage an dthen the same record loaded through load scripts. They both are completely different. It sems like one is looking like a multibite and th eother is stored as single bit .It is like below.

Record through Datastage
---------------------------
DG-3 Διακήρυξη ανοιχτής C38EC294C38EC2B9C38EC2B1C38EC 2BAC38EC2AEC38FC281C38FC285C38EC5B8C38EC2B720C38EC2B1C38EC593C38EC2BFC38EC2B9C38FC287C38FC284C38 EC2AEC38FC28220
Record Thorugh Load scripts
-----------------------------

DG-3 CE94CEB9CEB1CEBACEAECF81CF85CEBECEB720CEB1CEBDCEBFCEB9CF87CF84CEAECF82
M.T.Anwer
The day the child realizes that all adults are imperfect he becomes an adolescent;
the day he forgives them, he becomes an adult; the day he forgives himself, he becomes wise.
-Aiden Nowlan
mosenga
Participant
Posts: 2
Joined: Mon Feb 05, 2007 12:51 pm

same problem on linux redhat v3 update 5 AS

Post by mosenga »

Code: Select all

Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.000 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.001 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.002 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.003 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
DataStage Job 7 Phantom 28048
Program "DSR_GETPROP": Line 63, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_STAGETYPES/INDEX.000 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETPROP": Line 63, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_STAGETYPES/INDEX.001 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETPROP": Line 63, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_STAGETYPES/INDEX.002 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
[/quote]

and ran the command that ray said... look...


Code: Select all

[dsadm@sscllinuxora03 DSEngine]$ analyze.shm -t0 |grep NLS
[dsadm@sscllinuxora03 DSEngine]$ analyze.shm -t0
Current tunable parameter settings:
     MFILES         =   100
     T30FILE        =   400
     OPENCHK        =   1
     WIDE0          =   0x3dc00000
     UVSPOOL        =   /tmp
     UVTEMP         =   /tmp
     SCRMIN         =   3
     SCRMAX         =   5
     SCRSIZE        =   512
     QDEPTH         =   16
     HISTSTK        =   99
     QSRUNSZ        =   2000
     QSBRNCH        =   4
     QSDEPTH        =   8
     QSMXKEY        =   32
     TXMODE         =   0
     LOGBLSZ        =   512
     LOGBLNUM       =   8
     LOGSYCNT       =   0
     LOGSYINT       =   0
     TXMEM          =   32
     OPTMEM         =   64
Press any key to continue...
     SELBUF         =   4
     ULIMIT         =   128000
     FSEMNUM        =   23
     GSEMNUM        =   97
     PSEMNUM        =   64
     FLTABSZ        =   11
     GLTABSZ        =   130
     RLTABSZ        =   130
     RLOWNER        =   50
     PAKTIME        =   300
     NETTIME        =   5
     QBREAK         =   1
     VDIVDEF        =   1
     UVSYNC         =   0
     BLKMAX         =   8192
     PICKNULL       =   0
     SYNCALOC       =   0
     MAXRLOCK       =   129
     ISOMODE        =   1
     PKRJUST        =   0
     PROCACMD       =   0
     PROCRCMD       =   0
     PROCPRMT       =   0
Press any key to continue...
     ALLOWNFS       =   1
     CSHDISPATCH    =   /bin/csh
     SHDISPATCH     =   /bin/sh
     DOSDISPATCH    =   NOT_SUPPORTED
     LAYERSEL       =   0
     OCVDATE        =   0
     MODFPTRS       =   1
     THDR512        =   0
     UDRMODE        =   0
     UDRBLKS        =   0
     MAXERRLOGENT   =   100
     JOINBUF        =   4095
     64BIT_FILES    =   0
     TSTIMEOUT      =   60
     PIOPENDEFAULT  =   0
     MAXKEYSIZE     =   768
     SMISDATA       =   0
     EXACTNUMERIC   =   15
     MALLOCTRACING  =   0
     CENTURYPIVOT   =   1930
     SPINTRIES      =   0
     SPINSLEEP      =   0
     DISKCACHE      =   -1
Press any key to continue...
     DCBLOCKSIZE    =   16
     DCMODULUS      =   256
     DCMAXPCT       =   80
     DCFLUSHPCT     =   80
     DCCATALOGPCT   =   50
     DCWRITEDAEMON  =   0
     DMEMOFF        =   0xbdfd3000
     PMEMOFF        =   0xbf431000
     CMEMOFF        =   0xbf434000
     NMEMOFF        =   0xbf635000
     AUTHENTICATION =   0
     IMPERSONATION  =   1
     INSTANCETAG    =   ade
     HOSTFILELOCKING=   0
[dsadm@sscllinuxora03 DSEngine]$
any help will be very much appreciated... thanks
MOSENGA
mosenga
Participant
Posts: 2
Joined: Mon Feb 05, 2007 12:51 pm

same problem on linux redhat v3 update 5 AS

Post by mosenga »

Code: Select all

Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.000 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.001 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.002 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETJOB": Line 50, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_JOBS/INDEX.003 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
DataStage Job 7 Phantom 28048
Program "DSR_GETPROP": Line 63, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_STAGETYPES/INDEX.000 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETPROP": Line 63, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_STAGETYPES/INDEX.001 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
Program "DSR_GETPROP": Line 63, Index /local/Ascential/DataStage/Projects/Dev_NA/I_DS_STAGETYPES/INDEX.002 is configured to use a NLS locale (US-ENGLISH) for collation.  NLS is not currently enabled on this system.
[/quote]

and ran the command that ray said... look...


Code: Select all

[dsadm@sscllinuxora03 DSEngine]$ analyze.shm -t0 |grep NLS
[dsadm@sscllinuxora03 DSEngine]$ analyze.shm -t0
Current tunable parameter settings:
     MFILES         =   100
     T30FILE        =   400
     OPENCHK        =   1
     WIDE0          =   0x3dc00000
     UVSPOOL        =   /tmp
     UVTEMP         =   /tmp
     SCRMIN         =   3
     SCRMAX         =   5
     SCRSIZE        =   512
     QDEPTH         =   16
     HISTSTK        =   99
     QSRUNSZ        =   2000
     QSBRNCH        =   4
     QSDEPTH        =   8
     QSMXKEY        =   32
     TXMODE         =   0
     LOGBLSZ        =   512
     LOGBLNUM       =   8
     LOGSYCNT       =   0
     LOGSYINT       =   0
     TXMEM          =   32
     OPTMEM         =   64
Press any key to continue...
     SELBUF         =   4
     ULIMIT         =   128000
     FSEMNUM        =   23
     GSEMNUM        =   97
     PSEMNUM        =   64
     FLTABSZ        =   11
     GLTABSZ        =   130
     RLTABSZ        =   130
     RLOWNER        =   50
     PAKTIME        =   300
     NETTIME        =   5
     QBREAK         =   1
     VDIVDEF        =   1
     UVSYNC         =   0
     BLKMAX         =   8192
     PICKNULL       =   0
     SYNCALOC       =   0
     MAXRLOCK       =   129
     ISOMODE        =   1
     PKRJUST        =   0
     PROCACMD       =   0
     PROCRCMD       =   0
     PROCPRMT       =   0
Press any key to continue...
     ALLOWNFS       =   1
     CSHDISPATCH    =   /bin/csh
     SHDISPATCH     =   /bin/sh
     DOSDISPATCH    =   NOT_SUPPORTED
     LAYERSEL       =   0
     OCVDATE        =   0
     MODFPTRS       =   1
     THDR512        =   0
     UDRMODE        =   0
     UDRBLKS        =   0
     MAXERRLOGENT   =   100
     JOINBUF        =   4095
     64BIT_FILES    =   0
     TSTIMEOUT      =   60
     PIOPENDEFAULT  =   0
     MAXKEYSIZE     =   768
     SMISDATA       =   0
     EXACTNUMERIC   =   15
     MALLOCTRACING  =   0
     CENTURYPIVOT   =   1930
     SPINTRIES      =   0
     SPINSLEEP      =   0
     DISKCACHE      =   -1
Press any key to continue...
     DCBLOCKSIZE    =   16
     DCMODULUS      =   256
     DCMAXPCT       =   80
     DCFLUSHPCT     =   80
     DCCATALOGPCT   =   50
     DCWRITEDAEMON  =   0
     DMEMOFF        =   0xbdfd3000
     PMEMOFF        =   0xbf431000
     CMEMOFF        =   0xbf434000
     NMEMOFF        =   0xbf635000
     AUTHENTICATION =   0
     IMPERSONATION  =   1
     INSTANCETAG    =   ade
     HOSTFILELOCKING=   0
[dsadm@sscllinuxora03 DSEngine]$
any help will be very much appreciated... thanks
MOSENGA
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You left out the grep ! Anyway, this shows that NLS is not currently installed.

When you can get exclusive access to the project, execute the following command:

Code: Select all

DS.REINDEX ALL
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ufl_developer
Premium Member
Premium Member
Posts: 15
Joined: Wed Feb 20, 2008 3:33 pm

Post by ufl_developer »

ray.wurlod wrote:You left out the grep ! Anyway, this shows that NLS is not currently installed.

When you can get exclusive access to the project, execute the following command:

Code: Select all

DS.REINDEX ALL
Where to issue this command? (don't find it from anywhere)...

Our server is installed in Linux platform, version 7.5.2. Thanks!
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You can execute this command from the Administrator client's Command window. Be very sure that you have exclusive access to the project, otherwise your indexes will become invalidated.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
ufl_developer
Premium Member
Premium Member
Posts: 15
Joined: Wed Feb 20, 2008 3:33 pm

Post by ufl_developer »

ray.wurlod wrote:You can execute this command from the Administrator client's Command window. Be very sure that you have exclusive access to the project, otherwise your indexes will become invalidated.
I would assume that it is the same as 'rebuild repository index' within the DS.TOOLS from admin client interface?

Is there equivalent command from unix prompt? Thanks!
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

No not directly, but you can pop a 'DataStage shell' using dssh and then issue the DS.REINDEX command from the TCL prompt.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ufl_developer
Premium Member
Premium Member
Posts: 15
Joined: Wed Feb 20, 2008 3:33 pm

Post by ufl_developer »

chulett wrote:No not directly, but you can pop a 'DataStage shell' using dssh and then issue the DS.REINDEX command from the TCL prompt.
Thanks!
Post Reply