Aggregator stage error
Moderators: chulett, rschirm, roy
Aggregator stage error
Hi,
I am getting error on aggregator stage " Aggregator_43: Error when checking operator: Could not find input field ". The job was running fine until 3 days before suddenly it started throwing error when I tried to run today. I checked input columns and data everything seems fine and still I am not able to figure it out why it is happening? Any suggestions please.
Thank you,
I am getting error on aggregator stage " Aggregator_43: Error when checking operator: Could not find input field ". The job was running fine until 3 days before suddenly it started throwing error when I tried to run today. I checked input columns and data everything seems fine and still I am not able to figure it out why it is happening? Any suggestions please.
Thank you,
Bhanu
-
- Participant
- Posts: 62
- Joined: Thu Feb 08, 2007 6:01 am
- Location: Pune
Add the parameter APT_DUMP_SCORE and run the job with it set to true. Do all columns used actually exist in the flow?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Add the parameter APT_DUMP_SCORE and run the job with it set to true. Do all columns used actually exist in the flow?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
YEs ArndW,
I am calculating total sum in aggregator stage and then I am using sort stage, transformer and then a join and finally loading in to a oracle table. I am capturing key change in sort stage and after transfromer stage I dropped those key_change columns. Apart from that I am using everything.
Thank you,
I am calculating total sum in aggregator stage and then I am using sort stage, transformer and then a join and finally loading in to a oracle table. I am capturing key change in sort stage and after transfromer stage I dropped those key_change columns. Apart from that I am using everything.
Thank you,
Bhanu
You will get the same error with this parameter set, but in the log file you will now see the DataStage score (best to cut-and-paste it to an editor). Look at the score to ensure that all the column that you use in your aggregator stage are actually present at runtime.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Yes. Now look at your log file for the logging entries.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Sorry ArndW,
I got that value in log from Run Director only.
I am pasting the entire thing below.
Environment variable settings:
ALLUSERSPROFILE=C:\ProgramData
APPDATA=C:\Windows\system32\config\systemprofile\AppData\Roaming
APT_COMPILEOPT=-W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t-
APT_COMPILER=cxx
APT_CONFIG_FILE=C:/IBM/InformationServer/Server/Configurations/default.apt
APT_DUMP_SCORE=1
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=cxx
APT_LINKOPT=-s -W/dll -W/base:0x50000000 -W/Zc:wchar_t-
APT_MONITOR_MINTIME=10
APT_NO_ONE_NODE_COMBINING_OPTIMIZATION=1
APT_OPERATOR_REGISTRY_PATH=C:\IBM\InformationServer\Server\Projects\RDM\buildop
APT_ORCHHOME=C:/IBM/InformationServer/Server/PXEngine
APT_PHYSICAL_DATASET_BLOCK_SIZE=1048576
APT_USE_CRLF=1
BELL=^G
CLASSPATH=.;C:\IBM\SQLLIB\java\db2java.zip;C:\IBM\SQLLIB\java\db2jcc.jar;C:\IBM\SQLLIB\java\sqlj.zip;C:\IBM\SQLLIB\java\db2jcc_license_cu.jar;C:\IBM\SQLLIB\bin;C:\IBM\SQLLIB\java\common.jar
COMPUTERNAME=REMY
ComSpec=C:\Windows\system32\cmd.exe
CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files
CommonProgramFiles=C:\Program Files (x86)\Common Files
CommonProgramW6432=C:\Program Files\Common Files
DB2INSTANCE=DB2
DISPLAY=:0.0
DSIPC_OPEN_TIMEOUT=30
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_OPTIMIZE_FILE_BROWSE=0
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-4256
EEDB2ClientName=$PROJDEF (Replace with required value)
EEDB2Password=HDI@IJV8O9JN064IL:JD1K95F4>ID0UL@UC=kF;dG3Q?0PO8HM1dG61FEE1MN4=iHGH<H<0AC5<>:CLI64O0i<8VKOm<3U<4LLK@1KVA=93L0GGM=K
EEDB2Server=$PROJDEF (Replace with required value)
EEDB2UserID=$PROJDEF (Replace with required value)
FLAVOR=-1
FP_NO_HOST_CHECK=NO
INCLUDE=C:\IBM\SQLLIB\INCLUDE;C:\IBM\SQLLIB\LIB;C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\Include
ISUSER=jsam
LIB=C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\Lib;C:\IBM\SQLLIB\LIB
LOCALAPPDATA=C:\Windows\system32\config\systemprofile\AppData\Local
MAN_CHM_INDEX=C:/PROGRA~2/MKSTOO~1/etc/chm/tkutil.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tkapi.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tcltk.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tkcurses.idx
MAN_HTM_PATHS=C:/PROGRA~2/MKSTOO~1/etc/htm/perl;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/pod;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/ext;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/lib
MAN_TXT_INDEX=C:/PROGRA~2/MKSTOO~1/etc/tkutil.idx;C:/PROGRA~2/MKSTOO~1/etc/tkapi.idx;C:/PROGRA~2/MKSTOO~1/etc/tcltk.idx;C:/PROGRA~2/MKSTOO~1/etc/tkcurses.idx
NLS_LANG=AMERICAN_AMERICA.WE8MSWIN1252
NUMBER_OF_PROCESSORS=2
NUTCROOT=C:\PROGRA~2\MKSTOO~1
ORACLE_HOME=c:\app\product\11.2.0\client32
OS=Windows_NT
OSH_STDOUT_MSG=1
PATH=C:\IBM\InformationServer\Server\PXEngine\bin;C:\IBM\InformationServer\Server\PXEngine\osh_wrappers;C:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;C:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;C:\IBM\InformationServer\Server\DSComponents\bin;C:\IBM\InformationServer\Server\DSParallel;C:\IBM\InformationServer\Server\Projects\GTRI_Pilot\RT_BP120.O;C:\IBM\InformationServer\Server\DSEngine\bin;C:\IBM\InformationServer\Server\Projects\GTRI_Pilot\buildop;C:\IBM\InformationServer\Server\Projects\RDM\wrapped;C:\app\product\11.2.0\client32\bin;C:\app\product\11.2.0\client32;C:\Program Files (x86)\MKS Toolkit\mksnt;C:\PROGRA~2\MKSTOO~1\bin64;C:\PROGRA~2\MKSTOO~1\bin;C:\PROGRA~2\MKSTOO~1\bin\X11;C:\PROGRA~2\MKSTOO~1\mksnt;C:\IBM\InformationServer\ASBNode\apps\jre\bin\classic;C:\IBM\InformationServer\ASBNode\lib\cpp;C:\IBM\InformationServer\ASBNode\apps\proxy\cpp\vc60\MT_dll\bin;C:\Windows\system32;C:\Windows;C:\Windows\system32\wbem;C:\Windows\system32\windowspowershell\v1.0\;c:\program files\ibm\gsk8\lib64;C:\Windows/SysWOW64;c:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\IBM\SQLLIB\BIN;C:\IBM\SQLLIB\FUNCTION;C:\IBM\SQLLIB\SAMPLES\REPL;
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.sh;.ksh;.csh;.sed;.awk;.pl
PIDTOK=6956
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_ARCHITEW6432=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 44 Stepping 2, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=2c02
PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
PUBLIC=C:\Users\Public
PWD=C:\IBM\InformationServer\Server\Projects\RDM
PX_DBCONNECTHOME=C:/IBM/InformationServer/Server/DSComponents
ProgramData=C:\ProgramData
ProgramFiles(x86)=C:\Program Files (x86)
ProgramFiles=C:\Program Files (x86)
ProgramW6432=C:\Program Files
ROOTDIR=C:/PROGRA~2/MKSTOO~1
SHELL=C:/PROGRA~2/MKSTOO~1/mksnt/sh.exe
StgSchema=$PROJDEF (Replace with required value)
SystemDrive=C:
SystemRoot=C:\Windows
TEMP=C:\Windows\TEMP
TERM=console
TERMCAP=C:\PROGRA~2\MKSTOO~1\etc\termcap
TERMINFO=C:\PROGRA~2\MKSTOO~1\usr\lib\terminfo
TMP=C:\Windows\TEMP
TrgDMNLSchema=$PROJDEF (Replace with required value)
TrgDSN=$PROJDEF (Replace with required value)
TrgFACTSchema=$PROJDEF (Replace with required value)
TrgSchema=$PROJDEF (Replace with required value)
TrgStgSchema=$PROJDEF (Replace with required value)
UNIVERSE_CONTROLLING_TERM=1
UNIVERSE_PARENT_PROCESS=6956
USER=AD\jsam3
USERDOMAIN=AD
USERNAME=REMY$
USERPROFILE=C:\Windows\system32\config\systemprofile
VS100COMNTOOLS=C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\Tools\
VS90COMNTOOLS=C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\Tools
WHO=RDM
windir=C:\Windows
Thank you,
I got that value in log from Run Director only.
I am pasting the entire thing below.
Environment variable settings:
ALLUSERSPROFILE=C:\ProgramData
APPDATA=C:\Windows\system32\config\systemprofile\AppData\Roaming
APT_COMPILEOPT=-W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t-
APT_COMPILER=cxx
APT_CONFIG_FILE=C:/IBM/InformationServer/Server/Configurations/default.apt
APT_DUMP_SCORE=1
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=cxx
APT_LINKOPT=-s -W/dll -W/base:0x50000000 -W/Zc:wchar_t-
APT_MONITOR_MINTIME=10
APT_NO_ONE_NODE_COMBINING_OPTIMIZATION=1
APT_OPERATOR_REGISTRY_PATH=C:\IBM\InformationServer\Server\Projects\RDM\buildop
APT_ORCHHOME=C:/IBM/InformationServer/Server/PXEngine
APT_PHYSICAL_DATASET_BLOCK_SIZE=1048576
APT_USE_CRLF=1
BELL=^G
CLASSPATH=.;C:\IBM\SQLLIB\java\db2java.zip;C:\IBM\SQLLIB\java\db2jcc.jar;C:\IBM\SQLLIB\java\sqlj.zip;C:\IBM\SQLLIB\java\db2jcc_license_cu.jar;C:\IBM\SQLLIB\bin;C:\IBM\SQLLIB\java\common.jar
COMPUTERNAME=REMY
ComSpec=C:\Windows\system32\cmd.exe
CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files
CommonProgramFiles=C:\Program Files (x86)\Common Files
CommonProgramW6432=C:\Program Files\Common Files
DB2INSTANCE=DB2
DISPLAY=:0.0
DSIPC_OPEN_TIMEOUT=30
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_OPTIMIZE_FILE_BROWSE=0
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-4256
EEDB2ClientName=$PROJDEF (Replace with required value)
EEDB2Password=HDI@IJV8O9JN064IL:JD1K95F4>ID0UL@UC=kF;dG3Q?0PO8HM1dG61FEE1MN4=iHGH<H<0AC5<>:CLI64O0i<8VKOm<3U<4LLK@1KVA=93L0GGM=K
EEDB2Server=$PROJDEF (Replace with required value)
EEDB2UserID=$PROJDEF (Replace with required value)
FLAVOR=-1
FP_NO_HOST_CHECK=NO
INCLUDE=C:\IBM\SQLLIB\INCLUDE;C:\IBM\SQLLIB\LIB;C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\Include
ISUSER=jsam
LIB=C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\Lib;C:\IBM\SQLLIB\LIB
LOCALAPPDATA=C:\Windows\system32\config\systemprofile\AppData\Local
MAN_CHM_INDEX=C:/PROGRA~2/MKSTOO~1/etc/chm/tkutil.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tkapi.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tcltk.idx;C:/PROGRA~2/MKSTOO~1/etc/chm/tkcurses.idx
MAN_HTM_PATHS=C:/PROGRA~2/MKSTOO~1/etc/htm/perl;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/pod;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/ext;C:/PROGRA~2/MKSTOO~1/etc/htm/perl/lib
MAN_TXT_INDEX=C:/PROGRA~2/MKSTOO~1/etc/tkutil.idx;C:/PROGRA~2/MKSTOO~1/etc/tkapi.idx;C:/PROGRA~2/MKSTOO~1/etc/tcltk.idx;C:/PROGRA~2/MKSTOO~1/etc/tkcurses.idx
NLS_LANG=AMERICAN_AMERICA.WE8MSWIN1252
NUMBER_OF_PROCESSORS=2
NUTCROOT=C:\PROGRA~2\MKSTOO~1
ORACLE_HOME=c:\app\product\11.2.0\client32
OS=Windows_NT
OSH_STDOUT_MSG=1
PATH=C:\IBM\InformationServer\Server\PXEngine\bin;C:\IBM\InformationServer\Server\PXEngine\osh_wrappers;C:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;C:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;C:\IBM\InformationServer\Server\DSComponents\bin;C:\IBM\InformationServer\Server\DSParallel;C:\IBM\InformationServer\Server\Projects\GTRI_Pilot\RT_BP120.O;C:\IBM\InformationServer\Server\DSEngine\bin;C:\IBM\InformationServer\Server\Projects\GTRI_Pilot\buildop;C:\IBM\InformationServer\Server\Projects\RDM\wrapped;C:\app\product\11.2.0\client32\bin;C:\app\product\11.2.0\client32;C:\Program Files (x86)\MKS Toolkit\mksnt;C:\PROGRA~2\MKSTOO~1\bin64;C:\PROGRA~2\MKSTOO~1\bin;C:\PROGRA~2\MKSTOO~1\bin\X11;C:\PROGRA~2\MKSTOO~1\mksnt;C:\IBM\InformationServer\ASBNode\apps\jre\bin\classic;C:\IBM\InformationServer\ASBNode\lib\cpp;C:\IBM\InformationServer\ASBNode\apps\proxy\cpp\vc60\MT_dll\bin;C:\Windows\system32;C:\Windows;C:\Windows\system32\wbem;C:\Windows\system32\windowspowershell\v1.0\;c:\program files\ibm\gsk8\lib64;C:\Windows/SysWOW64;c:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\IBM\SQLLIB\BIN;C:\IBM\SQLLIB\FUNCTION;C:\IBM\SQLLIB\SAMPLES\REPL;
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.sh;.ksh;.csh;.sed;.awk;.pl
PIDTOK=6956
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_ARCHITEW6432=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 44 Stepping 2, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=2c02
PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
PUBLIC=C:\Users\Public
PWD=C:\IBM\InformationServer\Server\Projects\RDM
PX_DBCONNECTHOME=C:/IBM/InformationServer/Server/DSComponents
ProgramData=C:\ProgramData
ProgramFiles(x86)=C:\Program Files (x86)
ProgramFiles=C:\Program Files (x86)
ProgramW6432=C:\Program Files
ROOTDIR=C:/PROGRA~2/MKSTOO~1
SHELL=C:/PROGRA~2/MKSTOO~1/mksnt/sh.exe
StgSchema=$PROJDEF (Replace with required value)
SystemDrive=C:
SystemRoot=C:\Windows
TEMP=C:\Windows\TEMP
TERM=console
TERMCAP=C:\PROGRA~2\MKSTOO~1\etc\termcap
TERMINFO=C:\PROGRA~2\MKSTOO~1\usr\lib\terminfo
TMP=C:\Windows\TEMP
TrgDMNLSchema=$PROJDEF (Replace with required value)
TrgDSN=$PROJDEF (Replace with required value)
TrgFACTSchema=$PROJDEF (Replace with required value)
TrgSchema=$PROJDEF (Replace with required value)
TrgStgSchema=$PROJDEF (Replace with required value)
UNIVERSE_CONTROLLING_TERM=1
UNIVERSE_PARENT_PROCESS=6956
USER=AD\jsam3
USERDOMAIN=AD
USERNAME=REMY$
USERPROFILE=C:\Windows\system32\config\systemprofile
VS100COMNTOOLS=C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\Tools\
VS90COMNTOOLS=C:\Program Files (x86)\Microsoft Visual Studio 10.0\Common7\Tools
WHO=RDM
windir=C:\Windows
Thank you,
Bhanu
You will now have a big log entry shown as "OSH script (...)"
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>