Fresh Install...Compile problem with transformer

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Fresh Install...Compile problem with transformer

Post by kaps »

Hi

We have installed EE 7.5.2 in a new server and when we try to compile a job with transformer it's failing with following errors...
##E TBLD 000000 14:49:35(010) <main_program> Error when checking composite operator: Subprocess command failed with exit status 32512.
##E TFSR 000019 14:49:35(011) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 14:49:35(012) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 14:49:35(013) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/vacpp/bin/xlC_r: not found
##I TFCP 000000 14:49:35(014) <transform> Error when checking composite operator: /usr/vacpp/bin/xlC_r -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -O -c -qspill=32704 /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.C -o /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.tmp.o.
##E TCOS 000029 14:49:35(015) <main_program> Creation of a step finished with status = FAILED. (TestParallel.Transformer_3)
After reading the forum I was looking for the /usr/vacpp/bin/xlC_r directory but I could not find it. When I talked with my Sys Admins I have got the following path where they have installed c++ compiler.

/usr/lpp/xlC/lib

So I replaced APT_COMPILER and APT_LINKER env variables with the above mentioned value but I get a different error now...
##E TBLD 000000 16:32:10(006) <main_program> Error when checking composite operator: Subprocess command failed with exit status 32256.
##E TFSR 000019 16:32:10(007) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 16:32:10(008) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 16:32:10(009) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/lpp/xlC/lib: cannot execute

##I TFCP 000000 16:32:10(010) <transform> Error when checking composite operator: /usr/lpp/xlC/lib -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -O -c -qspill=32704 /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.C -o /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.tmp.o.
##E TCOS 000029 16:32:10(011) <main_program> Creation of a step finished with status = FAILED. (TestParallel.Transformer_3)
Please tell me what need to be changed or How do I make sure that c++ compiler is installed correctly in cright place ?

Please advise.

Thanks for your time...
jseclen
Participant
Posts: 133
Joined: Wed Mar 05, 2003 4:19 pm
Location: Lima - Peru. Sudamerica
Contact:

Re: Fresh Install...Compile problem with transformer

Post by jseclen »

Hi kaps,

Did you check the version for the compiler and the operating system??

Which OS and compiler are you installing??

I think that is a path problem, but i was expect for your answer to check.
Saludos,

Miguel Seclén
Lima - Peru
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Thanks for the reply.

OS is AIX 5.3

Compiler details are...
xlC.aix50.rte 10.1.0.0 COMMITTED XL C/C++ Runtime for AIX 5.3
xlC.msg.en_US.rte 10.1.0.0 COMMITTED XL C/C++ Runtime
xlC.rte 10.1.0.0 COMMITTED XL C/C++ Runtime

Please let me know.

Thanks
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

It would seem that you declared your compiler command to be "/usr/lpp/xlC/lib" in your Administrator.
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Thanks Arnd. Yes. I did mentioned that in my original post that I have replaced the APT_COMPILER and APT_LINKER env variables with /usr/lpp/xlC/lib because I was told thats where they installed the compiler and we did not have a directory like /usr/vacpp/bin/

I am completely lost here. so what should I enter in those variables.

Please advice.

Thanks
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Some more details about the environment...

lslpp -L | grep -i xlc gives the following...
xlC.aix50.rte 9.0.0.1 C F XL C/C++ Runtime for AIX 5.2
xlC.cpp 9.0.0.0 C F C for AIX Preprocessor
xlC.rte 9.0.0.1 C F XL C/C++ Runtime
Our AIX version is 5.3 and I don't know why it says XL C/C++ Runtime for AIX 5.2 in first line. Could this be an issue ?

Below are the values for env variables set in Administrator...Please let me know if this looks OK...

APT_COMPILEOPT = -O -c -qspill=32704
APT_COMPILER = /usr/lpp/xlC/exe/xlCcpp
APT_LINKER = /usr/lpp/xlC/exe/xlCcpp
APT_LINKOPT = -G



I have changed the APT_COMPILER and APT_LINKER to above mentioned values but then I got different errors...
##E TBLD 000000 13:46:07(010) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E TFSR 000019 13:46:07(011) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 13:46:07(012) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 13:46:07(013) <main_program> Error when checking composite operator: Output from subprocess: 1506-173 (W) Option c is not valid. Enter xlc for list of valid options.

##W TBLD 000000 13:46:07(014) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/rtti.h", line 287.8: 1506-234 (
##I TFCP 000000 13:46:07(015) <transform> Error when checking composite operator: /usr/lpp/xlC/exe/xlCcpp -O -I/opt/dsadm/Ascential/DataStage/PXEngine/include -O -c -qspill=32704 /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.C -o /datastage/DataStage/Projects/srcdev/RT_BP732.O/V0S3_TestParallel_Transformer_3.tmp.o.
##W TBLD 000000 13:46:07(016) <main_program> Error when checking composite operator: Output from subprocess: W) Expecting a new-line character on #endif directive.

##W TBLD 000000 13:46:07(017) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line 94.2
##W TBLD 000000 13:46:07(018) <main_program> Error when checking composite operator: Output from subprocess: : 1506-205 (S) #error "Platform Not Recognized"

##W TBLD 000000 13:46:07(019) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line
##W TBLD 000000 13:46:07(020) <main_program> Error when checking composite operator: Output from subprocess: 613.2: 1506-205 (S
##W TBLD 000000 13:46:07(021) <main_program> Error when checking composite operator: Output from subprocess: ) #error "Macros to align to int or long boundaries are not defined"

##W TBLD 000000 13:46:07(022) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line
##W TBLD 000000 13:46:07(023) <main_program> Error when checking composite operator: Output from subprocess: 624.2: 1506-205 (S) #error "No 64bit type in order to have macro to align to boundary"

##W TBLD 000000 13:46:07(024) <main_program> Error when checking composite operator: Output from subprocess: "/opt/dsadm/Ascential/DataStage/PXEngine/include/apt_util/condition.h", line
##W TBLD 000000 13:46:07(025) <main_program> Error when checking composite operator: Output from subprocess: 651.2: 1506-205 (S
##W TBLD 000000 13:46:07(026) <main_program> Error when checking composite operator: Output from subprocess: ) #error "Currently you must define either HAVE_LONG_LONG or LONG_IS_64_BITS"
and some more lines of errors which I did not paste it here...

Please let me know.

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Let's start back at the beginning. What compiler make and model does the documentation say is supported on AIX? We've seen that 'supported' tends to mean 'only ones that work' for PX.
-craig

"You can never have too many knives" -- Logan Nine Fingers
jseclen
Participant
Posts: 133
Joined: Wed Mar 05, 2003 4:19 pm
Location: Lima - Peru. Sudamerica
Contact:

Post by jseclen »

kaps in your post this messages appear

##W TBLD 000000 14:49:35(013) <main_program> Error when checking composite operator: Output from subprocess: sh: /usr/vacpp/bin/xlC_r: not found

this file /usr/vacpp/bin/xlC_r exists in that path???

so, in the instalation guide appear the compiler certified by the version 7.5.x, in this case is the XL C/C++ v7 and your version is the v10, is that rigth???
Saludos,

Miguel Seclén
Lima - Peru
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

jsecln - Please take a look at my first post in where I mentioned that since I was not able to find the /usr/vacpp/bin/xlC_r file I replaced it.

AS of now it looks in /usr/lpp/xlC/exe/ folder.

Please look at my last post and tell me what could be the problem.

Thanks
Kappi
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

With the values you have in APT_COMPILER_OPT try to compile a c++ code .If it producing the .so file then it means you have given correct value .
Nag
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Craig - To answer your question...In documentation it says "XLC C++ v7 is required for DataStage EE". I would think anything greater than 7 should be good. Is that correct ?

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Not necessarily, we've seen other examples here where newer versions do not work and you need to use the version indicated in the docs. Someone on an AIX box (or from IBM) would need to answer that question for us.
-craig

"You can never have too many knives" -- Logan Nine Fingers
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Nagarjuna - Where should I look for the.so file ?

Thanks
kaps
Participant
Posts: 452
Joined: Tue May 10, 2005 12:36 pm

Post by kaps »

Can anyone answer this question of whether we need to have same version mentioned in the docs or can we have any higher versions ?

We contacted IBM and they yet to get back to us on this.

I was hoping someone would have atleast faced the same problem.

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You'll have to wait for IBM to get back to you on your exact situation, but anecdotal evidence here suggests it must be the version noted in the docs. Unless another AIX user has experience with this exact same combination?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply