Compilation error....

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mallireddibalaji
Participant
Posts: 24
Joined: Wed Mar 19, 2008 1:13 am

Compilation error....

Post by mallireddibalaji »

Hi guru's,

I am getting below error while compiling the job.please any one give any idea to solve this error and please tell me how to compile the parallel routine.

Output from transformer compilation follows:

##I TFCN 000001 08:40:59(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5.1A
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved


##I TUTL 000031 08:40:59(001) <main_program> The open files limit is 500; raising to 65536.
##I TOSH 000002 08:40:59(002) <main_program> orchgeneral: loaded
##I TOSH 000002 08:40:59(003) <main_program> orchsort: loaded
##I TOSH 000002 08:40:59(004) <main_program> orchstats: loaded
##I TFSC 000001 08:40:59(007) <main_program> APT configuration file: /apps/Ascential/DataStage/Configurations/EDW_4_Node_Conf.apt
##I TFSC 000000 08:40:59(008) <main_program>
This step has 1 dataset:
ds0: {op0[1p] (parallel APT_LicenseCountOp in APT_LicenseOperator)
->eCollectAny
op1[1p] (sequential APT_LicenseCheckOp in APT_LicenseOperator)}

It has 2 operators:
op0[1p] {(parallel APT_LicenseCountOp in APT_LicenseOperator)
on nodes (
node1[op0,p0]
)}
op1[1p] {(sequential APT_LicenseCheckOp in APT_LicenseOperator)
on nodes (
node2[op1,p0]
)}
It runs 2 processes on 2 nodes.
##W TFPA 000017 08:40:59(009) <main_program> Warning: the value of the PWD environment variable (/apps/Ascential/DataStage/DSEngine) does not appear to be a synonym for the current working directory (/apps/Ascential/Projects/edw_stage). The current working directory will be used, but if your ORCHESTRATE job does not start up correctly, you should set your PWD environment variable to a value that will work on all nodes of your system.
##W TCOS 000049 08:41:00(000) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E TBLD 000000 08:41:07(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E TFSR 000019 08:41:07(001) <main_program> Could not check all operators because of previous error(s)
##W TFCP 000000 08:41:07(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##W TBLD 000000 08:41:07(003) <main_program> Error when checking composite operator: Output from subprocess: ld: fatal: library -lConvertWebChar: not found
ld: fatal: File processing errors. No output written to /apps/Ascential/Projects/edw_stage/RT_BP4334.O/V0S166_ecf7003a2_TrmtemWebDesc.so

##I TFCP 000000 08:41:07(004) <transform> Error when checking composite operator: /opt/SUNWspro/bin/CC -L/apps/Ascential/Projects/edw_stage/RT_BP4334.O/ -L/apps/Ascential/Projects/edw_stage/ -L/apps/Ascential/DataStage/PXEngine/lib -L/apps/Ascential/DataStage/PXEngine/user_lib -G -library=iostream -lorchsun4 -lorchcoresun4 -lorchbuildopsun4 -lConvertWebChar /apps/Ascential/Projects/edw_stage/RT_BP4334.O/V0S166_ecf7003a2_TrmtemWebDesc.tmp.o -o /apps/Ascential/Projects/edw_stage/RT_BP4334.O/V0S166_ecf7003a2_TrmtemWebDesc.so.
##E TCOS 000029 08:41:07(005) <main_program> Creation of a step finished with status = FAILED. (ecf7003a2.TrmtemWebDesc)

*** Internal Generated Transformer Code follows:
0001: //
0002: // Generated file to implement the V0S166_ecf7003a2_TrmtemWebDesc transform operator.
0003: //
0004:
0005: // define external functions used
0006: extern string ConvertWebChar(string WebStringInput);
0007:
0008: // define our input/output link names
0009: inputname 0 LnkTrmtemWebDesc;
0010: outputname 0 LnkSrtIemWebDesc;
0011:
0012: initialize {
0013: // define our row rejected variable
0014: int8 RowRejected0;
0015:
0016: // define our null set variable
0017: int8 NullSetVar0;
0018:
0019: }
0020:
0021: mainloop {
0022: // initialise our row rejected variable
0023: RowRejected0 = 1;
0024:
0025: // declare our intermediate variables for this section
0026: string InterVar0_0;
0027:
0028: // evaluate columns (no constraints) for link: LnkSrtIemWebDesc
0029: if (notnull(LnkTrmtemWebDesc.ITEM_WEB_DESC_T)) {
0030: InterVar0_0 = ConvertWebChar(LnkTrmtemWebDesc.ITEM_WEB_DESC_T);
0031: LnkSrtIemWebDesc.ITEM_WEB_DESC_T = InterVar0_0;
0032: } else {
0033: LnkSrtIemWebDesc.ITEM_WEB_DESC_T = LnkTrmtemWebDesc.ITEM_WEB_DESC_T;
0034: }
0035: //;
0036: writerecord 0;
0037: RowRejected0 = 0;
0038: }
0039:
0040: finish {
0041: }
0042:
*** End of Internal Generated Transformer Code
M.BALAJI
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

have you ever compiled any jobs in this environment?

"the value of the PWD environment variable (/apps/Ascential/DataStage/DSEngine) does not appear to be a synonym for the current working directory (/apps/Ascential/Projects/edw_stage). The current working directory will be used, but if your ORCHESTRATE job does not start up correctly, you should set your PWD environment variable to a value that will work on all nodes of your system"

does this mean anything to you?
have you correctly define the datastage path in your profile?
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

It looks more like
Output from subprocess: ld: fatal: library -lConvertWebChar: not found
is an issue. What is your platform and what are your settings for APT_COMPILEOPT, APT_COMPILER, APT_LINKER and APT_LINKOPT?
z035011
Premium Member
Premium Member
Posts: 26
Joined: Thu Nov 15, 2007 8:51 am

Post by z035011 »

Hi Arndw.
below is the settings:

Name prompt value

APT_compileopt compiler option -dalign -O -PIC -library=iostream -c

APT_compiler compiler /opt/SUNWspro/bin/CC

APT_Linker Linker /opt/SUNWspro/bin/CC

APT_linkopt linker options -G -library=iostream
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Is there a compile script in your "/apps/Ascential/Projects/edw_stage/RT_BP4334" directory and if so, can you execute it?
z035011
Premium Member
Premium Member
Posts: 26
Joined: Thu Nov 15, 2007 8:51 am

Post by z035011 »

there is no any file under the same path.

/apps/Ascential/Projects/edw_stage/RT_BP4334>ls -l
total 0
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

What about the ""/apps/Ascential/Projects/edw_stage/RT_BP4334.O" directory?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You should be looking in /apps/Ascential/Projects/edw_stage/RT_SC4334
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
z035011
Premium Member
Premium Member
Posts: 26
Joined: Thu Nov 15, 2007 8:51 am

Post by z035011 »

yes files are there...

/apps/Ascential/Projects/edw_stage/RT_SC4334>ls -l
total 14
-rwxrwxr-- 1 dsadm dstage 644 May 22 04:59 OshExecuter.sh
-rw-rw-r-- 1 dsadm dstage 3724 May 22 04:59 OshScript.osh
-rwxrwxr-x 1 a035304 dstage 928 May 21 03:32 V0S166_ecf7003a2_TrmtemWebDesc.trx
-rwxrwxr-x 1 a033988 dstage 584 May 21 06:08 V0S166_ecf7003a2_TrmtemWebDesc.trx.osh
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I'm not sure which files Ray wanted to look at, but I was looking for source or object code and would be in the ""/apps/Ascential/Projects/edw_stage/RT_BP4334.O" directory. Is there a .C or .so file in there?
z035011
Premium Member
Premium Member
Posts: 26
Joined: Thu Nov 15, 2007 8:51 am

Post by z035011 »

There si no any files ..under
/apps/Ascential/Projects/edw_stage/RT_BP4334.O>ls -l
total 0
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Ok, that means the compile cleaned up after itself.

Do you have any PX jobs with transform stages that compile correctly? If you create a simple dummy job with a row generator -> transform -> peek stage does that compile?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The *.trx file is the C++ source code generated when the Transformer stage is compiled.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply