Issue with CFF stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vskr72
Premium Member
Premium Member
Posts: 128
Joined: Wed Apr 28, 2004 9:36 pm

Issue with CFF stage

Post by vskr72 »

I have a simple job which loads data from a EBCDIC file to a table. I have a Pivot stage between SRC file and Target table. This is a horizontal pivot. When I try to compile I get this error. I have other jobs which compile good. So its not a compiler issue. Any inputs pls. Thanks.

Code: Select all

Output from transformer compilation follows:

##I IIS-DSEE-TFCN-00001 18:38:09(000) <main_program> 
IBM WebSphere DataStage Enterprise Edition 8.5.0.5946 
Copyright (c) 2001, 2005-2008 IBM Corporation. All rights reserved

##I IIS-DSEE-TFCN-00006 18:38:09(001) <main_program> conductor uname: -s=Linux; -r=2.6.32-131.17.1.el6.x86_64; -v=#1 SMP Thu Sep 29 10:24:25 EDT 2011; -n=infosphere2.nnn.net; -m=x86_64
##I IIS-DSEE-TOSH-00002 18:38:09(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 18:38:09(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 18:38:09(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 18:38:09(007) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##W IIS-DSEE-TFTM-00012 18:38:09(009) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##E IIS-DSEE-TFPS-00041 18:38:09(010) <transform> Error when checking composite operator: The field must be an output field; [line 133, character 21].
##E IIS-DSEE-TFPS-00041 18:38:09(011) <transform> Error when checking composite operator: The field must be an output field; [line 141, character 29].
##E IIS-DSEE-TFPS-00041 18:38:09(012) <transform> Error when checking composite operator: The field must be an output field; [line 149, character 29].
##E IIS-DSEE-TFPS-00041 18:38:09(013) <transform> Error when checking composite operator: The field must be an output field; [line 157, character 25].
##E IIS-DSEE-TFPS-00041 18:38:09(014) <transform> Error when checking composite operator: The field must be an output field; [line 165, character 21].
##E IIS-DSEE-TFPS-00041 18:38:09(015) <transform> Error when checking composite operator: The field must be an output field; [line 173, character 21].
##E IIS-DSEE-TFPS-00041 18:38:09(016) <transform> Error when checking composite operator: The field must be an output field; [line 181, character 27].
##E IIS-DSEE-TFPS-00041 18:38:09(017) <transform> Error when checking composite operator: The field must be an output field; [line 189, character 27].
##E IIS-DSEE-TFPS-00041 18:38:09(018) <transform> Error when checking composite operator: The field must be an output field; [line 195, character 26].
##E IIS-DSEE-TFPS-00041 18:38:09(019) <transform> Error when checking composite operator: The field must be an output field; [line 203, character 33].
##E IIS-DSEE-TFPS-00041 18:38:09(020) <transform> Error when checking composite operator: The field must be an output field; [line 211, character 33].
##E IIS-DSEE-TFPS-00041 18:38:09(021) <transform> Error when checking composite operator: The field must be an output field; [line 219, character 35].
##E IIS-DSEE-TFPS-00041 18:38:09(022) <transform> Error when checking composite operator: The field must be an output field; [line 227, character 34].
##E IIS-DSEE-TFPS-00041 18:38:09(023) <transform> Error when checking composite operator: The field must be an output field; [line 235, character 35].
##E IIS-DSEE-TFPS-00041 18:38:09(024) <transform> Error when checking composite operator: The field must be an output field; [line 243, character 34].
##E IIS-DSEE-TFSR-00019 18:38:09(025) <main_program> Could not check all operators because of previous error(s)
##E IIS-DSEE-TCOS-00029 18:38:09(026) <main_program> Creation of a step finished with status = FAILED. (TestJB_FIS_GL_ACCT1.Transformer_17)

*** Internal Generated Transformer Code follows:
0001: //
0002: // Generated file to implement the V2S0_TestJB_FIS_GL_ACCT1_Transformer_17 transform operator.
0003: //
0004: 
0005: // define our input/output link names
0006: inputname 0 ToTfm;
0007: outputname 0 ToPivot;
0008: 
0009: global {
0010: 	ustring DSJobName;
0011: }
0012: 
0013: initialize {
0014: 	// define our control variables
0015: 	int8 RowRejected0;
0016: 	int8 NullSetVar0;
0017: 
0018: 	// define our force_error call variables
0019: 	ustring FErrorMsg0;
0020: 	ustring FErrorLink0;
0021: 
0022: 	// define our SCD surrogate key variables
0023: 	ustring SurrKey_id0;
0024: 	int32 SurrKey_rc0;
0025: 	int32 SeedValue0;
0026: 	uint64 surrKey0;
0027: 
0028: 	// declare our intermediate variables for this section
0029: 	string InterVar0_0;
0030: 	string InterVar0_2;
0031: 	string InterVar0_9;
0032: 	string InterVar0_10;
0033: 	string InterVar0_17;
0034: 	string InterVar0_18;
0035: 	string InterVar0_19;
0036: 	string InterVar0_22;
0037: 	string InterVar0_24;
0038: 	string InterVar0_25;
0039: 	string InterVar0_26;
0040: 	string InterVar0_27;
0041: 	string InterVar0_28;
0042: 	string InterVar0_29;
0043: 	string InterVar0_30;
0044: 	string InterVar0_31;
0045: 	string InterVar0_32;
0046: 	string InterVar0_33;
0047: 	string InterVar0_34;
0048: 	string InterVar0_35;
0049: 	string InterVar0_36;
0050: 
0051: 	// initialise constant values which require conversion
0052: 	InterVar0_0 = "int32";
0053: 	InterVar0_2 = "decimal[15,2]";
0054: 	InterVar0_9 = "date";
0055: 	InterVar0_10 = "%yyyy-%mm-%dd";
0056: 	InterVar0_17 = "GL_AACT";
0057: 	InterVar0_18 = "AC_COST_CENTER_NBR  ";
0058: 	InterVar0_19 = "|";
0059: 	InterVar0_22 = "VALID";
0060: 	InterVar0_24 = "AC_THIS_MO_BEG_BAL ";
0061: 	InterVar0_25 = "AC_CURRENT_BAL";
0062: 	InterVar0_26 = "AC_MTD_BAL";
0063: 	InterVar0_27 = "AC_WTD_BAL";
0064: 	InterVar0_28 = "AC_TODAY_TRAN_DR ";
0065: 	InterVar0_29 = "AC_TODAY_TRAN_CR ";
0066: 	InterVar0_30 = "AC_PROCESS_DATE";
0067: 	InterVar0_31 = "AC_ANNUAL_BDGT_THIS_YR";
0068: 	InterVar0_32 = "AC_ANNUAL_BDGT_LAST_YR";
0069: 	InterVar0_33 = "AC_ANNUAL_BDGT_SECOND_YR";
0070: 	InterVar0_34 = "AC_ANNUAL_BDGT_THIRD_YR";
0071: 	InterVar0_35 = "AC_ANNUAL_BDGT_FOURTH_YR";
0072: 	InterVar0_36 = "AC_ANNUAL_BDGT_FIFTH_YR";
0073: 	// Stage variable declaration and initialisation
0074: 	int64 StageVar0_SK;
0075: 	StageVar0_SK = 1;
0076: 
0077: 	// initialise surrogate key
0078: 	SurrKey_id0 = "/opt/IBM/InformationServer/Projects/dev/DEV_EDW/params/ret_sk_state_file_new";
0079: 	SeedValue0 = 1;
0080: 	SurrKey_rc0 = surrogatekey_init(SurrKey_id0, SeedValue0, 150);
0081: 	if (SurrKey_rc0 != 0)
0082: 	{
0083: 		FErrorMsg0 = "Error in initializing surrogate key!";
0084: 		u_force_error(FErrorMsg0);
0085: 	}
0086: }
0087: 
0088: mainloop {
0089: 
0090: 	// declare our intermediate variables for this section
0091: 	ustring InterVar0_1;
0092: 	ustring InterVar0_3;
0093: 	ustring InterVar0_4;
0094: 	ustring InterVar0_5;
0095: 	ustring InterVar0_6;
0096: 	ustring InterVar0_7;
0097: 	ustring InterVar0_8;
0098: 	ustring InterVar0_11;
0099: 	ustring InterVar0_12;
0100: 	ustring InterVar0_13;
0101: 	ustring InterVar0_14;
0102: 	ustring InterVar0_15;
0103: 	ustring InterVar0_16;
0104: 	string InterVar0_20;
0105: 	string InterVar0_21;
0106: 	string InterVar0_23;
0107: 
0108: 	// evaluate the stage variables first
0109: 	StageVar0_SK = surrogatekey_generate();
0110: 
0111: 	// initialise the rejected row variable
0112: 	RowRejected0 = 1;
0113: 
0114: 	// evaluate constraint and columns for link: ToPivot
0115: 	InterVar0_1 = ToTfm.AC_COST_CENTER_NBR;
0116: 	InterVar0_3 = ToTfm.AC_THIS_MO_BEG_BAL;
0117: 	InterVar0_4 = ToTfm.AC_CURRENT_BAL;
0118: 	InterVar0_5 = ToTfm.AC_MTD_BAL;
0119: 	InterVar0_6 = ToTfm.AC_WTD_BAL;
0120: 	InterVar0_7 = ToTfm.AC_TODAY_TRAN_DR;
0121: 	InterVar0_8 = ToTfm.AC_TODAY_TRAN_CR;
0122: 	InterVar0_11 = ToTfm.AC_ANNUAL_BDGT_THIS_YR;
0123: 	InterVar0_12 = ToTfm.AC_ANNUAL_BDGT_LAST_YR;
0124: 	InterVar0_13 = ToTfm.AC_ANNUAL_BDGT_SECOND_YR;
0125: 	InterVar0_14 = ToTfm.AC_ANNUAL_BDGT_THIRD_YR;
0126: 	InterVar0_15 = ToTfm.AC_ANNUAL_BDGT_FOURTH_YR;
0127: 	InterVar0_16 = ToTfm.AC_ANNUAL_BDGT_FIFTH_YR;
0128: 	if ((((((((((((((!(is_valid(InterVar0_0 , InterVar0_1)) || !(is_valid(InterVar0_2 , InterVar0_3))) || !(is_valid(InterVar0_2 , InterVar0_4))) || !(is_valid(InterVar0_2 , InterVar0_5))) || !(is_valid(InterVar0_2 , InterVar0_6))) || !(is_valid(InterVar0_2 , InterVar0_7))) || !(is_valid(InterVar0_2 , InterVar0_8))) || !(is_valid(InterVar0_9 , ToTfm.AC_PROCESS_DATE , InterVar0_10))) || !(is_valid(InterVar0_0 , InterVar0_11))) || !(is_valid(InterVar0_0 , InterVar0_12))) || !(is_valid(InterVar0_0 , InterVar0_13))) || !(is_valid(InterVar0_0 , InterVar0_14))) || !(is_valid(InterVar0_0 , InterVar0_15))) || !(is_valid(InterVar0_0 , InterVar0_16))))
0129: 	{
0130: 		ToPivot.SRC = InterVar0_17;
0131: 		ToPivot.RET_SK = StageVar0_SK;
0132: 		ToPivot.JOB_NM = DSJobName;
0133: 		ToPivot.CREATED_DT = current_date();
0134: 		InterVar0_21 = ToTfm.AC_COST_CENTER_NBR;
0135: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0136: 			InterVar0_20 = InterVar0_22;
0137: 		} else {
0138: 			InterVar0_23 = ToTfm.AC_COST_CENTER_NBR;
0139: 			InterVar0_20 = InterVar0_23;
0140: 		}
0141: 		ToPivot.AC_COST_CENTER_NBR = ((InterVar0_18 + InterVar0_19) + InterVar0_20);
0142: 		InterVar0_21 = ToTfm.AC_THIS_MO_BEG_BAL;
0143: 		if (is_valid(InterVar0_2 , InterVar0_21)) {
0144: 			InterVar0_20 = InterVar0_22;
0145: 		} else {
0146: 			InterVar0_23 = ToTfm.AC_THIS_MO_BEG_BAL;
0147: 			InterVar0_20 = InterVar0_23;
0148: 		}
0149: 		ToPivot.AC_THIS_MO_BEG_BAL = ((InterVar0_24 + InterVar0_19) + InterVar0_20);
0150: 		InterVar0_21 = ToTfm.AC_CURRENT_BAL;
0151: 		if (is_valid(InterVar0_2 , InterVar0_21)) {
0152: 			InterVar0_20 = InterVar0_22;
0153: 		} else {
0154: 			InterVar0_23 = ToTfm.AC_CURRENT_BAL;
0155: 			InterVar0_20 = InterVar0_23;
0156: 		}
0157: 		ToPivot.AC_CURRENT_BAL = ((InterVar0_25 + InterVar0_19) + InterVar0_20);
0158: 		InterVar0_21 = ToTfm.AC_MTD_BAL;
0159: 		if (is_valid(InterVar0_2 , InterVar0_21)) {
0160: 			InterVar0_20 = InterVar0_22;
0161: 		} else {
0162: 			InterVar0_23 = ToTfm.AC_MTD_BAL;
0163: 			InterVar0_20 = InterVar0_23;
0164: 		}
0165: 		ToPivot.AC_MTD_BAL = ((InterVar0_26 + InterVar0_19) + InterVar0_20);
0166: 		InterVar0_21 = ToTfm.AC_WTD_BAL;
0167: 		if (is_valid(InterVar0_2 , InterVar0_21)) {
0168: 			InterVar0_20 = InterVar0_22;
0169: 		} else {
0170: 			InterVar0_23 = ToTfm.AC_WTD_BAL;
0171: 			InterVar0_20 = InterVar0_23;
0172: 		}
0173: 		ToPivot.AC_WTD_BAL = ((InterVar0_27 + InterVar0_19) + InterVar0_20);
0174: 		InterVar0_21 = ToTfm.AC_TODAY_TRAN_DR;
0175: 		if (is_valid(InterVar0_2 , InterVar0_21)) {
0176: 			InterVar0_20 = InterVar0_22;
0177: 		} else {
0178: 			InterVar0_23 = ToTfm.AC_TODAY_TRAN_DR;
0179: 			InterVar0_20 = InterVar0_23;
0180: 		}
0181: 		ToPivot.AC_TODAY_TRAN_DR = ((InterVar0_28 + InterVar0_19) + InterVar0_20);
0182: 		InterVar0_21 = ToTfm.AC_TODAY_TRAN_CR;
0183: 		if (is_valid(InterVar0_2 , InterVar0_21)) {
0184: 			InterVar0_20 = InterVar0_22;
0185: 		} else {
0186: 			InterVar0_23 = ToTfm.AC_TODAY_TRAN_CR;
0187: 			InterVar0_20 = InterVar0_23;
0188: 		}
0189: 		ToPivot.AC_TODAY_TRAN_CR = ((InterVar0_29 + InterVar0_19) + InterVar0_20);
0190: 		if (is_valid(InterVar0_9 , ToTfm.AC_PROCESS_DATE , InterVar0_10)) {
0191: 			InterVar0_20 = InterVar0_22;
0192: 		} else {
0193: 			InterVar0_20 = ToTfm.AC_PROCESS_DATE;
0194: 		}
0195: 		ToPivot.AC_PROCESS_DATE = ((InterVar0_30 + InterVar0_19) + InterVar0_20);
0196: 		InterVar0_21 = ToTfm.AC_ANNUAL_BDGT_THIS_YR;
0197: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0198: 			InterVar0_20 = InterVar0_22;
0199: 		} else {
0200: 			InterVar0_23 = ToTfm.AC_ANNUAL_BDGT_THIS_YR;
0201: 			InterVar0_20 = InterVar0_23;
0202: 		}
0203: 		ToPivot.AC_ANNUAL_BDGT_THIS_YR = ((InterVar0_31 + InterVar0_19) + InterVar0_20);
0204: 		InterVar0_21 = ToTfm.AC_ANNUAL_BDGT_LAST_YR;
0205: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0206: 			InterVar0_20 = InterVar0_22;
0207: 		} else {
0208: 			InterVar0_23 = ToTfm.AC_ANNUAL_BDGT_LAST_YR;
0209: 			InterVar0_20 = InterVar0_23;
0210: 		}
0211: 		ToPivot.AC_ANNUAL_BDGT_LAST_YR = ((InterVar0_32 + InterVar0_19) + InterVar0_20);
0212: 		InterVar0_21 = ToTfm.AC_ANNUAL_BDGT_SECOND_YR;
0213: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0214: 			InterVar0_20 = InterVar0_22;
0215: 		} else {
0216: 			InterVar0_23 = ToTfm.AC_ANNUAL_BDGT_SECOND_YR;
0217: 			InterVar0_20 = InterVar0_23;
0218: 		}
0219: 		ToPivot.AC_ANNUAL_BDGT_SECOND_YR = ((InterVar0_33 + InterVar0_19) + InterVar0_20);
0220: 		InterVar0_21 = ToTfm.AC_ANNUAL_BDGT_THIRD_YR;
0221: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0222: 			InterVar0_20 = InterVar0_22;
0223: 		} else {
0224: 			InterVar0_23 = ToTfm.AC_ANNUAL_BDGT_THIRD_YR;
0225: 			InterVar0_20 = InterVar0_23;
0226: 		}
0227: 		ToPivot.AC_ANNUAL_BDGT_THIRD_YR = ((InterVar0_34 + InterVar0_19) + InterVar0_20);
0228: 		InterVar0_21 = ToTfm.AC_ANNUAL_BDGT_FOURTH_YR;
0229: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0230: 			InterVar0_20 = InterVar0_22;
0231: 		} else {
0232: 			InterVar0_23 = ToTfm.AC_ANNUAL_BDGT_FOURTH_YR;
0233: 			InterVar0_20 = InterVar0_23;
0234: 		}
0235: 		ToPivot.AC_ANNUAL_BDGT_FOURTH_YR = ((InterVar0_35 + InterVar0_19) + InterVar0_20);
0236: 		InterVar0_21 = ToTfm.AC_ANNUAL_BDGT_FIFTH_YR;
0237: 		if (is_valid(InterVar0_0 , InterVar0_21)) {
0238: 			InterVar0_20 = InterVar0_22;
0239: 		} else {
0240: 			InterVar0_23 = ToTfm.AC_ANNUAL_BDGT_FIFTH_YR;
0241: 			InterVar0_20 = InterVar0_23;
0242: 		}
0243: 		ToPivot.AC_ANNUAL_BDGT_FIFTH_YR = ((InterVar0_36 + InterVar0_19) + InterVar0_20);
0244: 		writerecord 0;
0245: 		RowRejected0 = 0;
0246: 	}
0247: }
0248: 
0249: finish {
0250: }
0251: 
*** End of Internal Generated Transformer Code

qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
I take that to mean you have one stage lacking a required reject link.
Choose a job you love, and you will never have to work a day in your life. - Confucius
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Multiple conflicting compilers installed onto the same operating system?

http://www-01.ibm.com/support/docview.w ... wg21399403
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply