QS Job - Standardize Stage with a Transformer Stage

bireswar.goswami · Post by **bireswar.goswami** » Sun Sep 14, 2008 11:53 pm

Hi All,

I have a Quality Stage Job that takes a flat file as input and then going to a Standardize Stage and the output goes to a Transformer Stage to create 3 additional columns in the output which is again going to a copy stage which in turn retrns the Standardize Data Set and Match Frequencies with the help of a Match Frequency Stage.

So the job looks like:
1) Sequencial File Stage => 2) Standardize Stage => 3) Transformer Stage => 4) Copy Stage and then o/p data sets of Standardize Data Set and Match Frequencies with the help of a Match Frequency Stage.

Now when I am compilling the job it is giving me error at Transformer Stage though I have checked the same many a times and the
Output from transformer compilation follows:

##I IIS-DSEE-TFCN-00001 10:54:56(000) <main_program>
IBM WebSphere DataStage Enterprise Edition 8.0.1.4458
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

##I IIS-DSEE-TOSH-00002 10:54:56(001) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 10:54:56(002) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 10:54:56(003) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 10:54:56(006) <main_program> Parameter specified but not used in flow: DSPXWorkingDir
##E IIS-DSEE-TBLD-00076 10:54:57(000) <main_program> Error when checking composite operator: Subprocess command failed with exit status 256.
##E IIS-DSEE-TFSR-00019 10:54:57(001) <main_program> Could not check all operators because of previous error(s)
##W IIS-DSEE-TFTM-00012 10:54:57(002) <transform> Error when checking composite operator: The number of reject datasets "0" is less than the number of input datasets "1".
##I IIS-DSEE-TBLD-00079 10:54:57(003) <transform> Error when checking composite operator: cxx -O -ID:/IBM/InformationServer/Server/PXEngine/include -W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t- D:/IBM/InformationServer/Server/Projects/test/RT_BP18.O/V0S16_J_GSQS_Standardize_CreateAdditional.C -o D:/IBM/InformationServer/Server/Projects/test/RT_BP18.O/V0S16_J_GSQS_Standardize_CreateAdditional.tmp.o.
##I IIS-DSEE-TBLD-00000 10:54:57(004) <main_program> Error when checking composite operator: Output from subprocess: Compiler "cl" not found.

##E IIS-DSEE-TCOS-00029 10:54:57(005) <main_program> Creation of a step finished with status = FAILED. (J_GSQS_Standardize.CreateAdditional)

*** Internal Generated Transformer Code follows:
0001: //
0002: // Generated file to implement the V0S16_J_GSQS_Standardize_CreateAdditional transform operator.
0003: //
0004:
0005: // define our input/output link names
0006: inputname 0 Standardized;
0007: outputname 0 ToCopy;
0008:
0009: initialize {
0010: // define our row rejected variable
0011: int8 RowRejected0;
0012:
0013: // define our null set variable
0014: int8 NullSetVar0;
0015:
0016: }
0017:
0018: mainloop {
0019: // initialise our row rejected variable
0020: RowRejected0 = 1;
0021:
0022: // evaluate columns (no constraints) for link: ToCopy
0023: NullSetVar0 = 0;
0024: if (null(Standardized.MatchFirstName_USNAME)) {
0025: NullSetVar0 = 1;
0026: } else {
0027: ToCopy.MatchFirst1 = u_substring_1(Standardized.MatchFirstName_USNAME , 1 , 1);
0028: }
0029: ToCopy.MatchFirst1 = (NullSetVar0 == 1) ? set_null() : ToCopy.MatchFirst1;
0030: NullSetVar0 = 0;
0031: if (null(Standardized.HouseNumber_USADDR)) {
0032: NullSetVar0 = 1;
0033: } else {
0034: ToCopy.HouseNumberFirstChar = u_substring_1(Standardized.HouseNumber_USADDR , 1 , 1);
0035: }
0036: ToCopy.HouseNumberFirstChar = (NullSetVar0 == 1) ? set_null() : ToCopy.HouseNumberFirstChar;
0037: NullSetVar0 = 0;
0038: if (null(Standardized.ZipCode_USAREA)) {
0039: NullSetVar0 = 1;
0040: } else {
0041: ToCopy.ZipCode3 = u_substring_1(Standardized.ZipCode_USAREA , 1 , 3);
0042: }
0043: ToCopy.ZipCode3 = (NullSetVar0 == 1) ? set_null() : ToCopy.ZipCode3;
0044: ToCopy.NameType = Standardized.NameType_USNAME;
0045: ToCopy.GenderCode = Standardized.GenderCode_USNAME;
0046: ToCopy.NamePrefix = Standardized.NamePrefix_USNAME;
0047: ToCopy.FirstName = Standardized.FirstName_USNAME;
0048: ToCopy.MiddleName = Standardized.MiddleName_USNAME;
0049: ToCopy.PrimaryName = Standardized.PrimaryName_USNAME;
0050: ToCopy.NameGeneration = Standardized.NameGeneration_USNAME;
0051: ToCopy.NameSuffix = Standardized.NameSuffix_USNAME;
0052: ToCopy.AdditionalName = Standardized.AdditionalName_USNAME;
0053: ToCopy.MatchFirstName = Standardized.MatchFirstName_USNAME;
0054: ToCopy.MatchFirstNameNYSIIS = Standardized.MatchFirstNameNYSIIS_USNAME;
0055: ToCopy.MatchFirstNameRVSNDX = Standardized.MatchFirstNameRVSNDX_USNAME;
0056: ToCopy.MatchPrimaryName = Standardized.MatchPrimaryName_USNAME;
0057: ToCopy.MatchPrimaryNameHashKey = Standardized.MatchPrimaryNameHashKey_USNAME;
0058: ToCopy.MatchPrimaryNamePackKey = Standardized.MatchPrimaryNamePackKey_USNAME;
0059: ToCopy.NumofMatchPrimaryWords = Standardized.NumofMatchPrimaryWords_USNAME;
0060: ToCopy.MatchPrimaryWord1 = Standardized.MatchPrimaryWord1_USNAME;
0061: ToCopy.MatchPrimaryWord2 = Standardized.MatchPrimaryWord2_USNAME;
0062: ToCopy.MatchPrimaryWord3 = Standardized.MatchPrimaryWord3_USNAME;
0063: ToCopy.MatchPrimaryWord4 = Standardized.MatchPrimaryWord4_USNAME;
0064: ToCopy.MatchPrimaryWord5 = Standardized.MatchPrimaryWord5_USNAME;
0065: ToCopy.MatchPrimaryWord1NYSIIS = Standardized.MatchPrimaryWord1NYSIIS_USNAME;
0066: ToCopy.MatchPrimaryWord1RVSNDX = Standardized.MatchPrimaryWord1RVSNDX_USNAME;
0067: ToCopy.MatchPrimaryWord2NYSIIS = Standardized.MatchPrimaryWord2NYSIIS_USNAME;
0068: ToCopy.MatchPrimaryWord2RVSNDX = Standardized.MatchPrimaryWord2RVSNDX_USNAME;
0069: ToCopy.UP_USNAME = Standardized.UnhandledPattern_USNAME;
0070: ToCopy.UD_USNAME = Standardized.UnhandledData_USNAME;
0071: ToCopy.IP_USNAME = Standardized.InputPattern_USNAME;
0072: ToCopy.ED_USNAME = Standardized.ExceptionData_USNAME;
0073: ToCopy.UOF_USNAME = Standardized.UserOverrideFlag_USNAME;
0074: ToCopy.HouseNumber = Standardized.HouseNumber_USADDR;
0075: ToCopy.HouseNumberSuffix = Standardized.HouseNumberSuffix_USADDR;
0076: ToCopy.StreetPrefixDirectional = Standardized.StreetPrefixDirectional_USADDR;
0077: ToCopy.StreetPrefixType = Standardized.StreetPrefixType_USADDR;
0078: ToCopy.StreetName = Standardized.StreetName_USADDR;
0079: ToCopy.StreetSuffixType = Standardized.StreetSuffixType_USADDR;
0080: ToCopy.StreetSuffixQualifier = Standardized.StreetSuffixQualifier_USADDR;
0081: ToCopy.StreetSuffixDirectional = Standardized.StreetSuffixDirectional_USADDR;
0082: ToCopy.RuralRouteType = Standardized.RuralRouteType_USADDR;
0083: ToCopy.RuralRouteValue = Standardized.RuralRouteValue_USADDR;
0084: ToCopy.BoxType = Standardized.BoxType_USADDR;
0085: ToCopy.BoxValue = Standardized.BoxValue_USADDR;
0086: ToCopy.FloorType = Standardized.FloorType_USADDR;
0087: ToCopy.FloorValue = Standardized.FloorValue_USADDR;
0088: ToCopy.UnitType = Standardized.UnitType_USADDR;
0089: ToCopy.UnitValue = Standardized.UnitValue_USADDR;
0090: ToCopy.MultiUnitType = Standardized.MultiUnitType_USADDR;
0091: ToCopy.MultiUnitValue = Standardized.MultiUnitValue_USADDR;
0092: ToCopy.BuildingName = Standardized.BuildingName_USADDR;
0093: ToCopy.AdditionalAddress = Standardized.AdditionalAddress_USADDR;
0094: ToCopy.AddressType = Standardized.AddressType_USADDR;
0095: ToCopy.StreetNameNYSIIS = Standardized.StreetNameNYSIIS_USADDR;
0096: ToCopy.StreetNameRVSNDX = Standardized.StreetNameRVSNDX_USADDR;
0097: ToCopy.UP_USADDR = Standardized.UnhandledPattern_USADDR;
0098: ToCopy.UD_USADDR = Standardized.UnhandledData_USADDR;
0099: ToCopy.IP_USADDR = Standardized.InputPattern_USADDR;
0100: ToCopy.ED_USADDR = Standardized.ExceptionData_USADDR;
0101: ToCopy.UOF_USADDR = Standardized.UserOverrideFlag_USADDR;
0102: ToCopy.CityName = Standardized.CityName_USAREA;
0103: ToCopy.StateAbbreviation = Standardized.StateAbbreviation_USAREA;
0104: ToCopy.ZipCode = Standardized.ZipCode_USAREA;
0105: ToCopy.Zip4AddonCode = Standardized.Zip4AddonCode_USAREA;
0106: ToCopy.CountryCode = Standardized.CountryCode_USAREA;
0107: ToCopy.CityNameNYSIIS = Standardized.CityNameNYSIIS_USAREA;
0108: ToCopy.CityNameRVSNDX = Standardized.CityNameRVSNDX_USAREA;
0109: ToCopy.UP_USAREA = Standardized.UnhandledPattern_USAREA;
0110: ToCopy.UD_USAREA = Standardized.UnhandledData_USAREA;
0111: ToCopy.IP_USAREA = Standardized.InputPattern_USAREA;
0112: ToCopy.ED_USAREA = Standardized.ExceptionData_USAREA;
0113: ToCopy.UOF_USAREA = Standardized.UserOverrideFlag_USAREA;
0114: ToCopy.ValidFlag = Standardized.ValidFlag_USTAXID;
0115: ToCopy.TaxID = Standardized.TaxID_USTAXID;
0116: ToCopy.UP_USTAXID = Standardized.UnhandledPattern_USTAXID;
0117: ToCopy.UD_USTAXID = Standardized.UnhandledData_USTAXID;
0118: ToCopy.IP_USTAXID = Standardized.InputPattern_USTAXID;
0119: ToCopy.ED_USTAXID = Standardized.ExceptionData_USTAXID;
0120: ToCopy.UOF_USTAXID = Standardized.UserOverrideFlag_USTAXID;
0121: writerecord 0;
0122: RowRejected0 = 0;
0123: }
0124:
0125: finish {
0126: }
0127:
*** End of Internal Generated Transformer Code

mahadev.v · Post by **mahadev.v** » Mon Sep 15, 2008 12:12 am

Do a search on "Subprocess command failed with exit status 256" and see if one of the posts help. Also looking at the error "Output from subprocess: Compiler "cl" not found" maybe the C++ compiler is not installed correctly or the environmental variables related to it are not set correctly.

bireswar.goswami · Post by **bireswar.goswami** » Mon Sep 22, 2008 11:15 pm

Thanks.....I have uninstalled the IIS Server, then I installed Dot Net enter prise editions and changed the environment variables. And then again I installed the IIS Server. Now running well.

Soma123 · Post by **Soma123** » Fri Mar 20, 2009 6:59 am

Hi Could you please tell me precisely what environment variable/ Compiler settings did you change? here I am facing the same issue too, but I don't want to uninstall IIS (IBM Information Server).
Thanks in advance.

ray.wurlod · Post by **ray.wurlod** » Fri Mar 20, 2009 4:35 pm

My guess would be some or all of the environment variables in the Compiler group.