Page 1 of 2

Fresh Install...Compile problem with transformer

Posted: Tue Jun 02, 2009 3:35 pm
by kaps
Hi

We have installed EE 7.5.2 in a new server and when we try to compile a job with transformer it's failing with following errors...
##E TBLD 000000 14:49:35(010) <main_program> Error when checking composite operator: Subprocess command failed with exit status 32512.
##E TFSR 000019 14:49:35(011) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 14:49:35(012) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 14:49:35(013) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/vacpp/bin/xlC_r: not found
##I TFCP 000000 14:49:35(014) <transform> Error when checking composite operator: /usr/vacpp/bin/xlC_r -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -O -c -qspill=32704 /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.C -o /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.tmp.o.
##E TCOS 000029 14:49:35(015) <main_program> Creation of a step finished with status = FAILED. (TestParallel.Transformer_3)
After reading the forum I was looking for the /usr/vacpp/bin/xlC_r directory but I could not find it. When I talked with my Sys Admins I have got the following path where they have installed c++ compiler.

/usr/lpp/xlC/lib

So I replaced APT_COMPILER and APT_LINKER env variables with the above mentioned value but I get a different error now...
##E TBLD 000000 16:32:10(006) <main_program> Error when checking composite operator: Subprocess command failed with exit status 32256.
##E TFSR 000019 16:32:10(007) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 16:32:10(008) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 16:32:10(009) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/lpp/xlC/lib: cannot execute

##I TFCP 000000 16:32:10(010) <transform> Error when checking composite operator: /usr/lpp/xlC/lib -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -O -c -qspill=32704 /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.C -o /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.tmp.o.
##E TCOS 000029 16:32:10(011) <main_program> Creation of a step finished with status = FAILED. (TestParallel.Transformer_3)
Please tell me what need to be changed or How do I make sure that c++ compiler is installed correctly in cright place ?

Please advise.

Thanks for your time...

Re: Fresh Install...Compile problem with transformer

Posted: Tue Jun 02, 2009 4:52 pm
by jseclen
Hi kaps,

Did you check the version for the compiler and the operating system??

Which OS and compiler are you installing??

I think that is a path problem, but i was expect for your answer to check.

Posted: Wed Jun 03, 2009 8:50 am
by kaps
Thanks for the reply.

OS is AIX 5.3

Compiler details are...
xlC.aix50.rte 10.1.0.0 COMMITTED XL C/C++ Runtime for AIX 5.3
xlC.msg.en_US.rte 10.1.0.0 COMMITTED XL C/C++ Runtime
xlC.rte 10.1.0.0 COMMITTED XL C/C++ Runtime

Please let me know.

Thanks

Posted: Wed Jun 03, 2009 9:33 am
by ArndW
It would seem that you declared your compiler command to be "/usr/lpp/xlC/lib" in your Administrator.

Posted: Wed Jun 03, 2009 9:57 am
by kaps
Thanks Arnd. Yes. I did mentioned that in my original post that I have replaced the APT_COMPILER and APT_LINKER env variables with /usr/lpp/xlC/lib because I was told thats where they installed the compiler and we did not have a directory like /usr/vacpp/bin/

I am completely lost here. so what should I enter in those variables.

Please advice.

Thanks

Posted: Wed Jun 03, 2009 1:21 pm
by kaps
Some more details about the environment...

lslpp -L | grep -i xlc gives the following...
xlC.aix50.rte 9.0.0.1 C F XL C/C++ Runtime for AIX 5.2
xlC.cpp 9.0.0.0 C F C for AIX Preprocessor
xlC.rte 9.0.0.1 C F XL C/C++ Runtime
Our AIX version is 5.3 and I don't know why it says XL C/C++ Runtime for AIX 5.2 in first line. Could this be an issue ?

Below are the values for env variables set in Administrator...Please let me know if this looks OK...

APT_COMPILEOPT = -O -c -qspill=32704
APT_COMPILER = /usr/lpp/xlC/exe/xlCcpp
APT_LINKER = /usr/lpp/xlC/exe/xlCcpp
APT_LINKOPT = -G



I have changed the APT_COMPILER and APT_LINKER to above mentioned values but then I got different errors...
##E TBLD 000000 13:46:07(010) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E TFSR 000019 13:46:07(011) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 13:46:07(012) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 13:46:07(013) <main_program> Error when checking composite operator: Output from subprocess: 1506-173 (W) Option c is not valid. Enter xlc for list of valid options.

##W TBLD 000000 13:46:07(014) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/rtti.h", line 287.8: 1506-234 (
##I TFCP 000000 13:46:07(015) <transform> Error when checking composite operator: /usr/lpp/xlC/exe/xlCcpp -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -O -c -qspill=32704 /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.C -o /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.tmp.o.
##W TBLD 000000 13:46:07(016) <main_program> Error when checking composite operator: Output from subprocess: W) Expecting a new-line character on #endif directive.

##W TBLD 000000 13:46:07(017) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line 94.2
##W TBLD 000000 13:46:07(018) <main_program> Error when checking composite operator: Output from subprocess: : 1506-205 (S) #error "Platform Not Recognized"

##W TBLD 000000 13:46:07(019) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line
##W TBLD 000000 13:46:07(020) <main_program> Error when checking composite operator: Output from subprocess: 613.2: 1506-205 (S
##W TBLD 000000 13:46:07(021) <main_program> Error when checking composite operator: Output from subprocess: ) #error "Macros to align to int or long boundaries are not defined"

##W TBLD 000000 13:46:07(022) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line
##W TBLD 000000 13:46:07(023) <main_program> Error when checking composite operator: Output from subprocess: 624.2: 1506-205 (S) #error "No 64bit type in order to have macro to align to boundary"

##W TBLD 000000 13:46:07(024) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line
##W TBLD 000000 13:46:07(025) <main_program> Error when checking composite operator: Output from subprocess: 651.2: 1506-205 (S
##W TBLD 000000 13:46:07(026) <main_program> Error when checking composite operator: Output from subprocess: ) #error "Currently you must define either HAVE_LONG_LONG or LONG_IS_64_BITS"
and some more lines of errors which I did not paste it here...

Please let me know.

Thanks

Posted: Wed Jun 03, 2009 1:38 pm
by chulett
Let's start back at the beginning. What compiler make and model does the documentation say is supported on AIX? We've seen that 'supported' tends to mean 'only ones that work' for PX.

Posted: Wed Jun 03, 2009 2:22 pm
by jseclen
kaps in your post this messages appear

##W TBLD 000000 14:49:35(013) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/vacpp/bin/xlC_r: not found

this file /usr/vacpp/bin/xlC_r exists in that path???

so, in the instalation guide appear the compiler certified by the version 7.5.x, in this case is the XL C/C++ v7 and your version is the v10, is that rigth???

Posted: Wed Jun 03, 2009 3:37 pm
by kaps
jsecln - Please take a look at my first post in where I mentioned that since I was not able to find the /usr/vacpp/bin/xlC_r file I replaced it.

AS of now it looks in /usr/lpp/xlC/exe/ folder.

Please look at my last post and tell me what could be the problem.

Thanks
Kappi

Posted: Wed Jun 03, 2009 10:41 pm
by nagarjuna
With the values you have in APT_COMPILER_OPT try to compile a c++ code .If it producing the .so file then it means you have given correct value .

Posted: Thu Jun 04, 2009 8:31 am
by kaps
Craig - To answer your question...In documentation it says "XLC C++ v7 is required for DataStage EE". I would think anything greater than 7 should be good. Is that correct ?

Thanks

Posted: Thu Jun 04, 2009 8:47 am
by chulett
Not necessarily, we've seen other examples here where newer versions do not work and you need to use the version indicated in the docs. Someone on an AIX box (or from IBM) would need to answer that question for us.

Posted: Thu Jun 04, 2009 8:51 am
by kaps
Nagarjuna - Where should I look for the.so file ?

Thanks

Posted: Mon Jun 08, 2009 9:30 am
by kaps
Can anyone answer this question of whether we need to have same version mentioned in the docs or can we have any higher versions ?

We contacted IBM and they yet to get back to us on this.

I was hoping someone would have atleast faced the same problem.

Thanks

Posted: Mon Jun 08, 2009 9:59 am
by chulett
You'll have to wait for IBM to get back to you on your exact situation, but anecdotal evidence here suggests it must be the version noted in the docs. Unless another AIX user has experience with this exact same combination?