Aggregator stage error

bond88 · Post by **bond88** » Fri Jun 28, 2013 8:52 am

Hi,
I am getting error on aggregator stage " Aggregator_43: Error when checking operator: Could not find input field ". The job was running fine until 3 days before suddenly it started throwing error when I tried to run today. I checked input columns and data everything seems fine and still I am not able to figure it out why it is happening? Any suggestions please.

Thank you,

crystal_pup · Post by **crystal_pup** » Fri Jun 28, 2013 9:11 am

Check if there are any warnings generated relating to "These columns will be dropped from the input link schema" during run time.

bond88 · Post by **bond88** » Fri Jun 28, 2013 9:17 am

No warnings at all. It's throwing error directly.

ArndW · Post by **ArndW** » Fri Jun 28, 2013 9:29 am

Add the parameter APT_DUMP_SCORE and run the job with it set to true. Do all columns used actually exist in the flow?

ArndW · Post by **ArndW** » Fri Jun 28, 2013 9:30 am

Add the parameter APT_DUMP_SCORE and run the job with it set to true. Do all columns used actually exist in the flow?

bond88 · Post by **bond88** » Fri Jun 28, 2013 9:32 am

YEs ArndW,
I am calculating total sum in aggregator stage and then I am using sort stage, transformer and then a join and finally loading in to a oracle table. I am capturing key change in sort stage and after transfromer stage I dropped those key_change columns. Apart from that I am using everything.

Thank you,

bond88 · Post by **bond88** » Fri Jun 28, 2013 9:37 am

Still getting same error.

ArndW · Post by **ArndW** » Fri Jun 28, 2013 9:39 am

You will get the same error with this parameter set, but in the log file you will now see the DataStage score (best to cut-and-paste it to an editor). Look at the score to ensure that all the column that you use in your aggregator stage are actually present at runtime.

bond88 · Post by **bond88** » Fri Jun 28, 2013 9:52 am

Am I looking at the correct variable?

APT_DUMP_SCORE=1

Thanks,

ArndW · Post by **ArndW** » Fri Jun 28, 2013 10:15 am

Yes. Now look at your log file for the logging entries.

bond88 · Post by **bond88** » Fri Jun 28, 2013 10:33 am

Sorry ArndW,
I got that value in log from Run Director only.

I am pasting the entire thing below.

Environment variable settings:
ALLUSERSPROFILE=C:\ProgramData
APPDATA=C:\Windows\system32\config\systemprofile\AppData\Roaming
APT_COMPILEOPT=-W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t-
APT_COMPILER=cxx
APT_CONFIG_FILE=C:/IBM/InformationServer/Server/Configurations/default.apt
APT_DUMP_SCORE=1
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=cxx
APT_LINKOPT=-s -W/dll -W/base:0x50000000 -W/Zc:wchar_t-
APT_MONITOR_MINTIME=10
APT_NO_ONE_NODE_COMBINING_OPTIMIZATION=1
APT_OPERATOR_REGISTRY_PATH=C:\IBM\InformationServer\Server\Projects\RDM\buildop
APT_ORCHHOME=C:/IBM/InformationServer/Server/PXEngine
APT_PHYSICAL_DATASET_BLOCK_SIZE=1048576
APT_USE_CRLF=1
BELL=^G
CLASSPATH=.;C:\IBM\SQLLIB\java\db2java.zip;C:\IBM\SQLLIB\java\db2jcc.jar;C:\IBM\SQLLIB\java\sqlj.zip;C:\IBM\SQLLIB\java\db2jcc_license_cu.jar;C:\IBM\SQLLIB\bin;C:\IBM\SQLLIB\java\common.jar
COMPUTERNAME=REMY
ComSpec=C:\Windows\system32\cmd.exe
CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files
CommonProgramFiles=C:\Program Files (x86)\Common Files
CommonProgramW6432=C:\Program Files\Common Files
DB2INSTANCE=DB2
DISPLAY=:0.0
DSIPC_OPEN_TIMEOUT=30
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_OPTIMIZE_FILE_BROWSE=0
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-4256
EEDB2ClientName=$PROJDEF (Replace with required value)
EEDB2Password=HDI@IJV8O9JN064IL:JD1K95F4>ID0UL@UC=kF;dG3Q?0PO8HM1dG61FEE1MN4=iHGH<H<0AC5<>:CLI64O0i<8VKOm<3U<4LLK@1KVA=93L0GGM=K
EEDB2Server=$PROJDEF (Replace with required value)
EEDB2UserID=$PROJDEF (Replace with required value)
FLAVOR=-1
FP_NO_HOST_CHECK=NO
INCLUDE=C:\IBM\SQLLIB\INCLUDE;C:\IBM\SQLLIB\LIB;C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\Include
ISUSER=jsam
LIB=C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\Lib;C:\IBM\SQLLIB\LIB
LOCALAPPDATA=C:\Windows\system32\config\systemprofile\AppData\Local
MAN_CHM_INDEX=C:/PROGRA~2/MKSTOO~1/etc/chm/tkutil.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tkapi.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tcltk.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tkcurses.idx
MAN_HTM_PATHS=C:/PROGRA~2/MKSTOO~1/etc/htm/perl;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/pod;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/ext;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/lib
MAN_TXT_INDEX=C:/PROGRA~2/MKSTOO~1/etc/tkutil.idx;C:/PROGRA~2/MKSTOO~1/etc/tkapi.idx;C:/PROGRA~2/MKSTOO~1/etc/tcltk.idx;C:/PROGRA~2/MKSTOO~1/etc/tkcurses.idx
NLS_LANG=AMERICAN_AMERICA.WE8MSWIN1252
NUMBER_OF_PROCESSORS=2
NUTCROOT=C:\PROGRA~2\MKSTOO~1
ORACLE_HOME=c:\app\product\11.2.0\client32
OS=Windows_NT
OSH_STDOUT_MSG=1
PATH=C:\IBM\InformationServer\Server\PXEngine\bin;C:\IBM\InformationServer\Server\PXEngine\osh_wrappers;C:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;C:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;C:\IBM\InformationServer\Server\DSComponents\bin;C:\IBM\InformationServer\Server\DSParallel;C:\IBM\InformationServer\Server\Projects\GTRI_Pilot\RT_BP120.O;C:\IBM\InformationServer\Server\DSEngine\bin;C:\IBM\InformationServer\Server\Projects\GTRI_Pilot\buildop;C:\IBM\InformationServer\Server\Projects\RDM\wrapped;C:\app\product\11.2.0\client32\bin;C:\app\product\11.2.0\client32;C:\Program Files (x86)\MKS Toolkit\mksnt;C:\PROGRA~2\MKSTOO~1\bin64;C:\PROGRA~2\MKSTOO~1\bin;C:\PROGRA~2\MKSTOO~1\bin\X11;C:\PROGRA~2\MKSTOO~1\mksnt;C:\IBM\InformationServer\ASBNode\apps\jre\bin\classic;C:\IBM\InformationServer\ASBNode\lib\cpp;C:\IBM\InformationServer\ASBNode\apps\proxy\cpp\vc60\MT_dll\bin;C:\Windows\system32;C:\Windows;C:\Windows\system32\wbem;C:\Windows\system32\windowspowershell\v1.0\;c:\program files\ibm\gsk8\lib64;C:\Windows/SysWOW64;c:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\IBM\SQLLIB\BIN;C:\IBM\SQLLIB\FUNCTION;C:\IBM\SQLLIB\SAMPLES\REPL;
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.sh;.ksh;.csh;.sed;.awk;.pl
PIDTOK=6956
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_ARCHITEW6432=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 44 Stepping 2, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=2c02
PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
PUBLIC=C:\Users\Public
PWD=C:\IBM\InformationServer\Server\Projects\RDM
PX_DBCONNECTHOME=C:/IBM/InformationServer/Server/DSComponents
ProgramData=C:\ProgramData
ProgramFiles(x86)=C:\Program Files (x86)
ProgramFiles=C:\Program Files (x86)
ProgramW6432=C:\Program Files
ROOTDIR=C:/PROGRA~2/MKSTOO~1
SHELL=C:/PROGRA~2/MKSTOO~1/mksnt/sh.exe
StgSchema=$PROJDEF (Replace with required value)
SystemDrive=C:
SystemRoot=C:\Windows
TEMP=C:\Windows\TEMP
TERM=console
TERMCAP=C:\PROGRA~2\MKSTOO~1\etc\termcap
TERMINFO=C:\PROGRA~2\MKSTOO~1\usr\lib\terminfo
TMP=C:\Windows\TEMP
TrgDMNLSchema=$PROJDEF (Replace with required value)
TrgDSN=$PROJDEF (Replace with required value)
TrgFACTSchema=$PROJDEF (Replace with required value)
TrgSchema=$PROJDEF (Replace with required value)
TrgStgSchema=$PROJDEF (Replace with required value)
UNIVERSE_CONTROLLING_TERM=1
UNIVERSE_PARENT_PROCESS=6956
USER=AD\jsam3
USERDOMAIN=AD
USERNAME=REMY$
USERPROFILE=C:\Windows\system32\config\systemprofile
VS100COMNTOOLS=C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\Tools\
VS90COMNTOOLS=C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\Tools
WHO=RDM
windir=C:\Windows

Thank you,

ArndW · Post by **ArndW** » Fri Jun 28, 2013 10:53 am

You will now have a big log entry shown as "OSH script (...)"

bond88 · Post by **bond88** » Fri Jun 28, 2013 10:58 am

I don't have any entries with OSH under run director log.

chulett · Post by **chulett** » Fri Jun 28, 2013 11:39 am

Bhanu - please use the Reply to topic button, there's no need to constantly 'Reply with quote' when we can all see the text of the message you are replying to. Thanks.

bond88 · Post by **bond88** » Fri Jun 28, 2013 11:56 am

chulett wrote: Bhanu - please use the Reply to topic button, there's no need to constantly 'Reply with quote' when we can all see the text of the message you are replying to. Thanks.

Sorry Chulett,
Generally I use Reply to Topic, but I didn't noticed on this one.

Thanks,