Error while running job after editing dsenv

srinivas.nettalam · Post by **srinivas.nettalam** » Wed Sep 26, 2012 5:41 am

Hi,
We have edited the dsenv to add the DB2 library path and restarted the dsengine and then ASBAgent.When the ./uv -admin -start command is issued it finished with the error below
DataStage Engine 8.7.0.0 instance "ade" has been brought up.
Starting JobMonApp

sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'

JobMonApp has been started.
resource_tracker has been started.
Then we ran the the parallel job which has a sequential file and a db2 api stage.The job reports completion but there is a blank fatal error and the following information messgae :

Contents of phantom output file
ERROR: ld.so: object 'SH' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'module' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'line' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object '1' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'syntax' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'error' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'unexpected' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'end' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'of' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'fileSH' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'error' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'importing' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'function' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'definition' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'for' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object '`module'/opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'SH' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'module' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'line' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object '1' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'syntax' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'error' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'unexpected' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'end' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'of' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'fileSH' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'error' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'importing' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'function' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'definition' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object 'for' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object '`module'/opt/IBM/InformationServer/Server/DSComponents/lib/libicui18n.so' from LD_PRELOAD cannot be preloaded: ignored.
SH: module: line 1: syntax error: unexpected end of file
SH: error importing function definition for `module'

Our dsenv file is as follows:

# PLATFORM SPECIFIC SECTION

set +u

if [ -z "$DSHOME" ] && [ -f "/.dshome" ]
then
DSHOME=`cat /.dshome`
export DSHOME
fi

if [ -z "$DSHOME" ]
then
DSHOME=/opt/IBM/InformationServer/Server/DSEngine; export DSHOME
fi

if [ -z "$DSRPCD_PORT_NUMBER" ]
then
true
DSRPCD_PORT_NUMBER=31538; export DSRPCD_PORT_NUMBER
fi

if [ -z "$APT_ORCHHOME" ]
then
APT_ORCHHOME=/opt/IBM/InformationServer/Server/PXEngine; export APT_ORCHHOME
fi

#if [ -z "$UDTHOME" ]
#then
UDTHOME=/opt/IBM/InformationServer/Server/DSEngine/ud41 ; export UDTHOME
UDTBIN=/opt/IBM/InformationServer/Server/DSEngine/ud41/bin ; export UDTBIN
#fi

#if [ -z "$ASBHOME" ] && [ -f "$DSHOME/.asbnode" ]
#then
ASBHOME=`cat $DSHOME/.asbnode`
export ASBHOME
#fi

#if [ -z "$ASBHOME" ]
#then
#ASBHOME=`dirname \`dirname $DSHOME\``/ASBNode
#export ASBHOME
#fi

if [ -n "$DSHOME" ] && [ -d "$DSHOME" ]
then
ODBCINI=$DSHOME/.odbc.ini; export ODBCINI
HOME=${HOME:-/}; export HOME

#LANG="<langdef>";export LANG
#LC_ALL="<langdef>";export LC_ALL
#LC_CTYPE="<langdef>";export LC_CTYPE
#LC_COLLATE="<langdef>";export LC_COLLATE
#LC_MONETARY="<langdef>";export LC_MONETARY
#LC_NUMERIC="<langdef>";export LC_NUMERIC
#LC_TIME="<langdef>";export LC_TIME
#LC_MESSAGES="<langdef>"; export LC_MESSAGES

LD_LIBRARY_PATH=`dirname $DSHOME`/branded_odbc/lib:`dirname $DSHOME`/DSComponents/lib:`dirname $DSHOME`/DSComponents/bin:$DSHOME/lib:$DSHOME/uvdlls:`dirname $DSHOME`/PXEngine/lib:$ASBHOME/apps/jre/bin:$ASBHOME/apps/jre/bin/classic:$ASBHOME/lib/cpp:$ASBHOME/apps/proxy/cpp/linux-all-x86_64:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH
LD_PRELOAD=`dirname $DSHOME`/DSComponents/lib/libicui18n.so
export LD_PRELOAD
# PATH=/home/db2inst1/sqllib/bin:$PATH;
# export PATH

fi

Please help in resolving this issue

ulab · Post by **ulab** » Wed Sep 26, 2012 6:25 am

Hi Srinivas

I hope a solution in the below URL,
http://www-01.ibm.com/support/docview.w ... wg21404749

srinivas.nettalam · Post by **srinivas.nettalam** » Wed Sep 26, 2012 6:54 am

Hi ulab,
The url shows the problem occuring during installation,But here we have installed and ran jobs properly before editing dsenv

chulett · Post by **chulett** » Wed Sep 26, 2012 6:58 am

I don't see where you set the DB2 library path. Regardless, I'd make sure your LD_LIBRARY_PATH is all one line with no accidental returns in it. It may also be too long now and need to be broken up into two statements.

ArndW · Post by **ArndW** » Wed Sep 26, 2012 6:58 am

*edit* If you look at one of the first entries in your log, you will see the runtime settings of the environment variables. It might be a good idea to compare those values with the ones in the dsenv file; particularly if a line break is in there as Craig hinted at being possible. *edit*

What did you change in the dsenv file and what happens if you take the preload definition and variable export out?

BI-RMA · Post by **BI-RMA** » Wed Sep 26, 2012 7:01 am

Hi srinivas,

you say you wanted to include DB2 library path in dsenv, but in fact you didn't. What I see is an entry for DB2 binaries that is commented out.

I'd expect an entry adding DB2 libraries to LD_LIBRARY_PATH.

srinivas.nettalam · Post by **srinivas.nettalam** » Wed Sep 26, 2012 7:48 am

chulett wrote:I don't see where you set the DB2 library path. Regardless, I'd make sure your LD_LIBRARY_PATH is all one line with no accidental returns in it. It may also be too long now and need to b ...

We have edited the dsenv to have proper line breaks but still when we start the engine we are getting the same error as

Starting JobMonApp
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `module'
JobMonApp has been started.
resource_tracker has been started.

Also an dsenv error file is getting created in the $DSHOME path and the last portion of it has the error as below

file name :dsenv.errs.120926.191419

LESSOPEN="|/usr/bin/lesspipe.sh %s"; export LESSOPEN
UDTHOME="/opt/IBM/InformationServer/Server/DSEngine/ud41"; export UDTHOME
G_BROKEN_FILENAMES="1"; export G_BROKEN_FILENAMES
module="() { eval `/usr/bin/modulecmd bash $*`"; export module

===Errors encountered during environment exporting===
cmdTrace.c(713):ERROR:104: 'start' is an unrecognized subcommand
cmdModule.c(411):ERROR:104: 'start' is an unrecognized subcommand

#then
ASBHOME=`cat $DSHOME/.asbnode`
export ASBHOME
#fi

#if [ -z "$ASBHOME" ]
#then
#ASBHOME=`dirname \`dirname $DSHOME\``/ASBNode
#export ASBHOME
#fi

if [ -n "$DSHOME" ] && [ -d "$DSHOME" ]
then
ODBCINI=$DSHOME/.odbc.ini; export ODBCINI
HOME=${HOME:-/}; export HOME

#LANG="<langdef>";export LANG
#LC_ALL="<langdef>";export LC_ALL
#LC_CTYPE="<langdef>";export LC_CTYPE
#LC_COLLATE="<langdef>";export LC_COLLATE
#LC_MONETARY="<langdef>";export LC_MONETARY
#LC_NUMERIC="<langdef>";export LC_NUMERIC
#LC_TIME="<langdef>";export LC_TIME
#LC_MESSAGES="<langdef>"; export LC_MESSAGES

LD_LIBRARY_PATH=`dirname $DSHOME`/branded_odbc/lib
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:`dirname $DSHOME`/DSComponents/lib
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:`dirname $DSHOME`/DSComponents/bin:$DSHOME/lib:$DSHOME/uvdlls
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:`dirname $DSHOME`/PXEngine/lib:$ASBHOME/apps/jre/bin:$ASBHOME/apps/jre/bin/classic:$ASBHOME/lib/cpp
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$ASBHOME/apps/proxy/cpp/linux-all-x86_64
export LD_LIBRARY_PATH
# LD_PRELOAD=`dirname $DSHOME`/DSComponents/lib/libicui18n.so
# export LD_PRELOAD
# PATH=/home/db2inst1/sqllib/bin:$PATH;
# export PATH

fi

srinivas.nettalam · Post by **srinivas.nettalam** » Wed Sep 26, 2012 7:52 am

BI-RMA wrote:you say you wanted to include DB2 library path in dsenv, but in fact you didn't. What I see is an entry for DB2 binaries that is commented out.

I'd expect an entry adding DB2 libraries to LD_LIBRARY_PATH.

Sorry,I forgot to mention that they are commented now.Earlier we added them to LD_LIBRARY_PATH and later we moved them to a dummy variable PATH and commented it.We brought the dsenv file to the earlier state but still we are getting the same errors

chulett · Post by **chulett** » Wed Sep 26, 2012 8:04 am

srinivas.nettalam wrote:We brought the dsenv file to the earlier state but still we are getting the same errors

If all you changed was the dsenv file then I would assert that you are not in fact at that 'earlier state'.

prasson_ibm · Post by **prasson_ibm** » Wed Sep 26, 2012 12:42 pm

Hi All,

This looks to be a issue with Operating system(Linux) Modules not with dsenv file.
Does anyone help us on this issue.

Thanks

FranklinE · Post by **FranklinE** » Thu Sep 27, 2012 8:46 am

Only because it hasn't been mentioned yet: unexpected end of file could be as simple as having DOS control characters in your Unix dsenv file.

prasson_ibm · Post by **prasson_ibm** » Thu Sep 27, 2012 11:31 am

FranklinE wrote:Only because it hasn't been mentioned yet: unexpected end of file could be as simple as having DOS control characters in your Unix dsenv file.

Ok....if it so then can you please suggest how we can resolve that issue.

chulett · Post by **chulett** » Thu Sep 27, 2012 11:53 am

Remove them. Not that different from my suggestion to double-check the file for stray returns. Use ":set list" in vi to help them show up if needed.

FranklinE · Post by **FranklinE** » Fri Sep 28, 2012 10:37 am

prasson_ibm wrote:Ok....if it so then can you please suggest how we can resolve that issue.

Two basic approaches here:

1. Enforce the use of an editor that automatically saves your edited file with Unix control characters. I use Kedit for Windows, and the Kedit commands "eolout lf" and "eofout eol". If you are not familiar with Kedit, look for an editor with that capability. Mansfield Software Group, the maker of Kedit, is out of business, though you might be able to find it for download somewhere.

2. Create a utility that will convert DOS control characters to Unix and make it part of the procedure for modifying Unix files. It shouldn't be that difficult. The "Unix in a Nutshell" book describes the "dos2unix" command line syntax.

prasson_ibm · Post by **prasson_ibm** » Sat Sep 29, 2012 10:56 am

chulett wrote:Remove them. Not that different from my suggestion to double-check the file for stray returns. Use ":set list" in vi to help them show up if needed. ...

Hi,

As suggested i checked the dsenv file with ":set list" and i can see some "^I" character at the starting of every line.I have no idea what is the significance to these special characters in dsenv file and how it came.

My next approach will be to remove this character from the dsenv and restart the engine and see if it works for me or not.

thanks
Prasoon