Reg the Parallel Job - Transformer compilation problem.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nimmy
Participant
Posts: 11
Joined: Thu Feb 28, 2008 6:26 am

Reg the Parallel Job - Transformer compilation problem.

Post by nimmy »

Job Details:
************
(SeqFile -> Transformer -> Seqfile)


Output from transformer compilation follows:

####################################################################################################

##I IIS-DSEE-TFCN-00001 14:33:57(000) <main_program>
IBM WebSphere DataStage Enterprise Edition 8.0.1.4468
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

##I IIS-DSEE-TUTL-00031 14:33:57(001) <main_program> The open files limit is 100; raising to 65536.
##I IIS-DSEE-TOSH-00002 14:33:57(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 14:33:57(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 14:33:57(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 14:33:57(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E IIS-DSEE-TBLD-00076 14:33:58(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E IIS-DSEE-TFSR-00019 14:33:58(001) <main_program> Could not check all operators because of previous error(s)
##W IIS-DSEE-TFTM-00012 14:33:58(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W IIS-DSEE-TBLD-00000 14:33:58(003) <main_program> Error when checking composite operator: Output from subprocess: "/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 23: Error: Could not open include file<strings.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 24: Error: Could not open include file<string.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 25: Error: Could not open include file<stdlib.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 295: Error: The function "str
##W IIS-DSEE-TBLD-00000 14:33:58(004) <main_program> Error when checking composite operator: Output from subprocess: len" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 295: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 295: Error: Cannot use int to initialize char*.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 296: Error: The function "strcpy" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti
##I IIS-DSEE-TBLD-00079 14:33:58(005) <transform> Error when checking composite operator: /export/home/ccd_5036/SUNWspro/prod/bin/CC -KPIC -O -I/ora817/opt2/IBM/InformationServer/Server/PXEngine/include -dalign -O -PIC -library=iostream -c /ora817/opt2/IBM/InformationServer/Server/Projects/Initial/RT_BP20.O/V0S2_PJTest_Transformation.C -o /ora817/opt2/IBM/InformationServer/Server/Projects/Initial/RT_BP20.O/V0S2_PJTest_Transformation.tmp.o.
##W IIS-DSEE-TBLD-00000 14:33:58(006) <main_program> Error when checking composite operator: Output from subprocess: .h", line 297: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 298: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 299: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 299: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/Informa
##W IIS-DSEE-TBLD-00000 14:33:58(007) <main_program> Error when checking composite operator: Output from subprocess: tionServer/Server/PXEngine/include/apt_util/rtti.h", line 300: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/rtti.h", line 300: Error: The function "strlen" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/condition.h", line 428: Error: Could not open include file<strings.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/fast_alloc.h", line 26: Error: Could not open in
##W IIS-DSEE-TBLD-00000 14:33:58(008) <main_program> Error when checking composite operator: Output from subprocess: clude file<stddef.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/fast_alloc.h", line 27: Error: Could not open include file<assert.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/fast_alloc.h", line 352: Error: The function "memset" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/apt_util/fast_alloc.h", line 648: Error: The function "memset" must have a prototype.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include
##W IIS-DSEE-TBLD-00000 14:33:58(009) <main_program> Error when checking composite operator: Output from subprocess: /unicode/platform.h", line 84: Error: Could not open include file<sys/types.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/unicode/platform.h", line 106: Error: Could not open include file<inttypes.h>.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/unicode/umachine.h", line 237: Error: int8_t is not defined.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/unicode/umachine.h", line 328: Error: uint16_t is not defined.
"/ora817/opt2/IBM/InformationServer/Server/PXEngi
##W IIS-DSEE-TBLD-00000 14:33:58(010) <main_program> Error when checking composite operator: Output from subprocess: ne/include/unicode/umachine.h", line 348: Error: int32_t is not defined.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/unicode/uversion.h", line 109: Error: uint8_t is not defined.
"/ora817/opt2/IBM/InformationServer/Server/PXEngine/include/unicode/utf8.h", line 57: Error: "," expected instead of "utf8_countTrailBytes_3_2".
Compilation aborted, too many Error messages.

##E IIS-DSEE-TCOS-00029 14:33:58(011) <main_program> Creation of a step finished with status = FAILED. (PJTest.Transformation)

*
o
+ Internal Generated Transformer Code follows:

0001: //
0002: // Generated file to implement the V0S2_PJTest_Transformation transform operator.
0003: //
0004:
0005: // define our input/output link names
0006: inputname 0 DSLink3;
0007: outputname 0 DSLink4;
0008:
0009: initialize {
0010: // define our row rejected variable
0011: int8 RowRejected0;
0012:
0013: // define our null set variable
0014: int8 NullSetVar0;
0015:
0016: }
0017:
0018: mainloop {
0019: // initialise our row rejected variable
0020: RowRejected0 = 1;
0021:
0022: // evaluate columns (no constraints) for link: DSLink4
0023: DSLink4.output = (DSLink3.input1 + DSLink3.input2);
0024: writerecord 0;
0025: RowRejected0 = 0;
0026: }
0027:
0028: finish {
0029: }
0030:

*
o
+ End of Internal Generated Transformer Code
Keep Smiling
kirankumarreddydesireddy
Participant
Posts: 110
Joined: Mon Jan 11, 2010 4:22 am

Post by kirankumarreddydesireddy »

Check if the C++ compiler is installed successfuly.





Thanks
Kiran
nimmy
Participant
Posts: 11
Joined: Thu Feb 28, 2008 6:26 am

Reg the Parallel Job - Transformer compilation problem.

Post by nimmy »

Hi Kiran,
Thanks for the Info.but can u kindly let me know how to check whether the c++ installed successfully.because we have installed the C++ compiler too.
Without transformer stage the jobs are compiling succesfully.
Keep Smiling
RikDeclercq
Participant
Posts: 11
Joined: Wed Mar 16, 2011 5:56 am

Re: Reg the Parallel Job - Transformer compilation problem.

Post by RikDeclercq »

Check if you have a valid license key.
nimmy
Participant
Posts: 11
Joined: Thu Feb 28, 2008 6:26 am

Re: Reg the Parallel Job - Transformer compilation problem.

Post by nimmy »

Hi,
Yes We have a valid license key too .
Keep Smiling
RikDeclercq
Participant
Posts: 11
Joined: Wed Mar 16, 2011 5:56 am

Re: Reg the Parallel Job - Transformer compilation problem.

Post by RikDeclercq »

Then I am afraid that I can't help, these things are handled by the guys from infrastructure.
kirankumarreddydesireddy
Participant
Posts: 110
Joined: Mon Jan 11, 2010 4:22 am

Re: Reg the Parallel Job - Transformer compilation problem.

Post by kirankumarreddydesireddy »

Please check with your software provider if you have valid license for parallel version too.

Thanks
Kiran
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

This isn't a license issue, it's a configuration issue. First you need to verify that you installed a supported compiler for your version. Secondly it needs to be configured correctly, something I'm assuming hasn't happened due to all of the "Could not open include file" warnings you are getting. Did whomever installed the compiler make any attempt to configure it as well?

Specifically, these four values need to be set correctly:

APT_COMPILER
APT_LINKER
APT_COMPILEOPT
APT_LINKOPT


From what I understand, they should be documented for whatever compiler(s) are supported by your platform/release.
-craig

"You can never have too many knives" -- Logan Nine Fingers
nimmy
Participant
Posts: 11
Joined: Thu Feb 28, 2008 6:26 am

Reg transformer compiler issue

Post by nimmy »

Hi Chulett,
Thankyou so much for your information. But kindly clarify me regarding the following :

we are using ,
sun studio 12 - Compiler Version
solaris 10 version 10/09 - Unix Os Version "10/09" is patch
IBM Information Server 8.1.0.1 - Data stage Version.

We configured APT_COMPILER and APT_LINKER
alone.

Can you Provide me the Configuration lists in detail. we are not having any info regarding the same.
Keep Smiling
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I personally can't, no, but my understanding is they are documented. Perhaps someone else can point you to the exact place.
-craig

"You can never have too many knives" -- Logan Nine Fingers
nimmy
Participant
Posts: 11
Joined: Thu Feb 28, 2008 6:26 am

Reg the Parallel Job - Transformer compilation problem.

Post by nimmy »

Kindly let me know any idea on the above issue. Still we are not able to solve it.
Keep Smiling
chanaka
Premium Member
Premium Member
Posts: 96
Joined: Tue Sep 15, 2009 4:06 am
Location: United States

Post by chanaka »

Hi Chulett,

Does the sun studio 12 installation need to be done as the root user?

Cheers!

Chanaka
Chanaka Wagoda
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I have no clue, what do the installation instructions say? Is that a supported compiler? Why not ask your official support provider for help?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply