Not able to Run Resource Estimation in Datastage PX job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chpraveen.msc
Participant
Posts: 26
Joined: Tue Nov 08, 2005 5:36 am

Not able to Run Resource Estimation in Datastage PX job

Post by chpraveen.msc »

Hello All,
Currently we are in a process of tuning the Datastage ETL code to meet
out SLA time lines. I thought , running the "Resource Estimates" and "Peformance Analysis" will give us a good idea, on where the bottle neck is, in a given ETL job. I am not able to run "Resource Estimation/ Performance Analysis" in Datastage Parallel job(New feature from Verison 8x) , jobs are getting aborted with the following warning when i run the "Resource Estimation".
My Datastage Version is 8.0 and my OS is "SUN OS".

Error Mesage: "Unexpected tokens: -f RT_SC846/OshScript.osh -pf RT_SC846/jpfile -impexp_charset UTF-8 ."


Attached below the complete log details.
DataStage Report - Detail Log for job: CopyOfjbDrmEdwFinForecastProdMap
Produced on: 12/17/2009 5:00:28 PM
Project: ERR_FRAMEWRK
Host system: SVLCGSETL02-DEV
Items: 1 - 129
Sorted on: Date Sorter

Item #: 1
Event ID: 0
Timestamp:: 2009-12-15 15:59:33
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)

p_rejectFileName = jbDrmEdwProdFinMap

Item #: 2
Event ID: 1
Timestamp:: 2009-12-15 15:59:34
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-1566
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/xxxxxx/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/xxxxxx/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/xxxxxx/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/xxxxxx/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=4395
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/xxxxxx/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 3
Event ID: 2
Timestamp:: 2009-12-15 15:59:34
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 4
Event ID: 3
Timestamp:: 2009-12-15 15:59:34
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 15:56:00 15 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: tfm_FinAcct
## Operator
transform
## Operator options
-flag run
-name 'V0S57_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinAcct'
## General options
[ident('tfm_FinAcct'); jobmon_ident('tfm_FinAcct')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
## Outputs
0> [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [modify (
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME,
KHALIX_ACCT_CODE,FINANCE_ACCOUNT_CODE_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 5
Event ID: 4
Timestamp:: 2009-12-15 15:59:34
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 6
Event ID: 5
Timestamp:: 2009-12-15 15:59:35
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 7
Event ID: 6
Timestamp:: 2009-12-15 15:59:35
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 8
Event ID: 7
Timestamp:: 2009-12-15 15:59:35
Type: Info
User Name: dsadm
Message:: main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded

Item #: 9
Event ID: 8
Timestamp:: 2009-12-15 15:59:37
Type: Info
User Name: dsadm
Message:: main_program: -db_cs option is deprecated.

Item #: 10
Event ID: 9
Timestamp:: 2009-12-15 15:59:39
Type: Info
User Name: dsadm
Message:: main_program: -nchar_cs option is deprecated.

Item #: 11
Event ID: 10
Timestamp:: 2009-12-15 16:00:47
Type: Info
User Name: dsadm
Message:: main_program: APT configuration file: /etl/apps/DS/InformationServer/Server/Configurations/4node.apt
{
node "node1"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource scratchdisk "/data/scratch1" {pools ""}
}
node "node2"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource scratchdisk "/data/scratch2" {pools ""}
}
node "node3"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource scratchdisk "/data/scratch3" {pools ""}
}
node "node4"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource scratchdisk "/data/scratch4" {pools ""}
}
}

Item #: 12
Event ID: 11
Timestamp:: 2009-12-15 16:00:47
Type: Fatal
User Name: dsadm
Message:: main_program: ORCHESTRATE step execution terminating due to SIGINT

Item #: 13
Event ID: 12
Timestamp:: 2009-12-15 16:00:52
Type: Fatal
User Name: dsadm
Message:: Parallel job was aborted

Item #: 14
Event ID: 13
Timestamp:: 2009-12-15 16:00:55
Type: Control
User Name: dsadm
Message:: Job CopyOfjbDrmEdwFinForecastProdMap aborted.

Item #: 15
Event ID: 14
Timestamp:: 2009-12-15 16:01:08
Type: Control
User Name: dsadm
Message:: Resetting Job CopyOfjbDrmEdwFinForecastProdMap.

Item #: 16
Event ID: 15
Timestamp:: 2009-12-15 16:01:08
Type: Control
User Name: dsadm
Message:: Job CopyOfjbDrmEdwFinForecastProdMap has been reset.

Item #: 17
Event ID: 16
Timestamp:: 2009-12-15 16:01:55
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)
psCommon.p_JobGroupName = EDW_GROUP1 (Compiled-in default)
psCommon.p_JobRunSequenceID = 1 (Compiled-in default)
psCommon.p_SurrogateKeyDir = /data/surrogate/ (Compiled-in default)
psCommon.p_DatasetDir = /data/datasets/ (Compiled-in default)
psCommon.p_rejectDir = /data/reject/ (Compiled-in default)
psCommon.p_rejectFileSuffix = .dat (Compiled-in default)
psCommon.p_CreateUser = ETLADM (Compiled-in default)
psCommon.p_Update_User = ETLADM (Compiled-in default)
psCommon.p_InputFileDir = /data/inbound/manufacturing/ (Compiled-in default)
psCommon.p_DrmSrcFileDir = /data/inbound/drm/ (Compiled-in default)
psCommon.p_DrmArchiveDir = /data/archive/drm/ (Compiled-in default)
psCommon.p_JobGroupRunID = 1 (Compiled-in default)
psCommon.p_InboundDir = /data/inbound/ (Compiled-in default)
psCommon.p_RecepientMailID = rramesh@xxxxxx.com (Compiled-in default)
psCommon.p_SenderMailID = dsadm@xxxxxx.com (Compiled-in default)
psCommon.p_MailServer = tahoe.xxxxxx.com (Compiled-in default)
psCommon.p_ArchiveDir = /data/archive/quarterly/drm/ (Compiled-in default)
psCommon.p_KhalixFlatFileDir = /data/inbound/khalix/ (Compiled-in default)
psCommon.p_EndCustomerInboundDir = /data/inbound/endcustomer/ (Compiled-in default)
psCommon.p_EndCustomerOutboundDir = /data/outbound/endcustomer/ (Compiled-in default)
psEDWDB = (As pre-defined)
psEDWDB.p_EDWDSN = DEDWNI01 (Compiled-in default)
psEDWDB.p_DimsSchema = DIMS (Compiled-in default)
psEDWDB.p_EDWUser = ETLADM (Compiled-in default)
psEDWDB.p_EDWPasswd = ******** (Compiled-in default)
psEDWDB.p_FactsSchema = FACTS (Compiled-in default)
psEDWDB.p_AggrSchema = AGGR (Compiled-in default)
psEDWDB.p_Etl_Schema = ETL (Compiled-in default)
p_JobGroupRunID = 1
p_SourceSystemKey = 7
p_rejectFileName = jbDrmEdwProdFinMap

Item #: 18
Event ID: 17
Timestamp:: 2009-12-15 16:01:55
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-2442
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/xxxxxx/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/xxxxxx/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/xxxxxx/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/xxxxxx/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=18541
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/xxxxxx/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 19
Event ID: 18
Timestamp:: 2009-12-15 16:01:55
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 20
Event ID: 19
Timestamp:: 2009-12-15 16:01:55
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 15:56:00 15 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: tfm_FinAcct
## Operator
transform
## Operator options
-flag run
-name 'V0S57_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinAcct'
## General options
[ident('tfm_FinAcct'); jobmon_ident('tfm_FinAcct')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
## Outputs
0> [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [modify (
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME,
KHALIX_ACCT_CODE,FINANCE_ACCOUNT_CODE_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 21
Event ID: 20
Timestamp:: 2009-12-15 16:01:55
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 22
Event ID: 21
Timestamp:: 2009-12-15 16:01:56
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 23
Event ID: 22
Timestamp:: 2009-12-15 16:01:57
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 24
Event ID: 23
Timestamp:: 2009-12-15 16:01:57
Type: Info
User Name: dsadm
Message:: main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded

Item #: 25
Event ID: 24
Timestamp:: 2009-12-15 16:01:58
Type: Info
User Name: dsadm
Message:: main_program: -db_cs option is deprecated.

Item #: 26
Event ID: 25
Timestamp:: 2009-12-15 16:02:00
Type: Info
User Name: dsadm
Message:: main_program: -nchar_cs option is deprecated.

Item #: 27
Event ID: 26
Timestamp:: 2009-12-15 16:13:05
Type: Info
User Name: dsadm
Message:: main_program: APT configuration file: /etl/apps/DS/InformationServer/Server/Configurations/4node.apt
{
node "node1"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource scratchdisk "/data/scratch1" {pools ""}
}
node "node2"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource scratchdisk "/data/scratch2" {pools ""}
}
node "node3"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource scratchdisk "/data/scratch3" {pools ""}
}
node "node4"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource scratchdisk "/data/scratch4" {pools ""}
}
}

Item #: 28
Event ID: 27
Timestamp:: 2009-12-15 16:13:06
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,2: Records inserted: 0
Records used for update: 79,030
Records rejected: 474
Total records: 79504.

Item #: 29
Event ID: 28
Timestamp:: 2009-12-15 16:13:09
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,1: Records inserted: 0
Records used for update: 79,028
Records rejected: 476
Total records: 79504.

Item #: 30
Event ID: 29
Timestamp:: 2009-12-15 16:13:10
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,0: Records inserted: 0
Records used for update: 79,036
Records rejected: 469
Total records: 79505.

Item #: 31
Event ID: 30
Timestamp:: 2009-12-15 16:13:10
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,3: Records inserted: 0
Records used for update: 79,027
Records rejected: 477
Total records: 79504.

Item #: 32
Event ID: 31
Timestamp:: 2009-12-15 16:13:10
Type: Info
User Name: dsadm
Message:: scErr_ProdFinMap.seq_rejectFile,0: Export complete; 0 records exported successfully, 0 rejected.

Item #: 33
Event ID: 32
Timestamp:: 2009-12-15 16:13:10
Type: Info
User Name: dsadm
Message:: main_program: Step execution finished with status = OK.

Item #: 34
Event ID: 33
Timestamp:: 2009-12-15 16:13:10
Type: Info
User Name: dsadm
Message:: main_program: Startup time, 0:05; production run time, 11:07.

Item #: 35
Event ID: 34
Timestamp:: 2009-12-15 16:13:10
Type: Info
User Name: dsadm
Message:: Parallel job reports successful completion

Item #: 36
Event ID: 35
Timestamp:: 2009-12-15 16:13:12
Type: Control
User Name: dsadm
Message:: Finished Job CopyOfjbDrmEdwFinForecastProdMap.

Item #: 37
Event ID: 36
Timestamp:: 2009-12-15 17:54:38
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)
psCommon.p_JobGroupName = EDW_GROUP1 (Compiled-in default)
psCommon.p_JobRunSequenceID = 1 (Compiled-in default)
psCommon.p_SurrogateKeyDir = /data/surrogate/ (Compiled-in default)
psCommon.p_DatasetDir = /data/datasets/ (Compiled-in default)
psCommon.p_rejectDir = /data/reject/ (Compiled-in default)
psCommon.p_rejectFileSuffix = .dat (Compiled-in default)
psCommon.p_CreateUser = ETLADM (Compiled-in default)
psCommon.p_Update_User = ETLADM (Compiled-in default)
psCommon.p_InputFileDir = /data/inbound/manufacturing/ (Compiled-in default)
psCommon.p_DrmSrcFileDir = /data/inbound/drm/ (Compiled-in default)
psCommon.p_DrmArchiveDir = /data/archive/drm/ (Compiled-in default)
psCommon.p_JobGroupRunID = 1 (Compiled-in default)
psCommon.p_InboundDir = /data/inbound/ (Compiled-in default)
psCommon.p_RecepientMailID = rramesh@xxxxxx.com (Compiled-in default)
psCommon.p_SenderMailID = dsadm@xxxxxx.com (Compiled-in default)
psCommon.p_MailServer = tahoe.xxxxxx.com (Compiled-in default)
psCommon.p_ArchiveDir = /data/archive/quarterly/drm/ (Compiled-in default)
psCommon.p_KhalixFlatFileDir = /data/inbound/khalix/ (Compiled-in default)
psCommon.p_EndCustomerInboundDir = /data/inbound/endcustomer/ (Compiled-in default)
psCommon.p_EndCustomerOutboundDir = /data/outbound/endcustomer/ (Compiled-in default)
psEDWDB = (As pre-defined)
psEDWDB.p_EDWDSN = DEDWNI01 (Compiled-in default)
psEDWDB.p_DimsSchema = DIMS (Compiled-in default)
psEDWDB.p_EDWUser = ETLADM (Compiled-in default)
psEDWDB.p_EDWPasswd = ******** (Compiled-in default)
psEDWDB.p_FactsSchema = FACTS (Compiled-in default)
psEDWDB.p_AggrSchema = AGGR (Compiled-in default)
psEDWDB.p_Etl_Schema = ETL (Compiled-in default)
p_JobGroupRunID = 1
p_SourceSystemKey = 7
p_rejectFileName = jbDrmEdwProdFinMap

Item #: 38
Event ID: 37
Timestamp:: 2009-12-15 17:54:39
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-24051
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/xxxxxx/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/xxxxxx/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/xxxxxx/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/xxxxxx/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=4395
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/xxxxxx/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 39
Event ID: 38
Timestamp:: 2009-12-15 17:54:39
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 40
Event ID: 39
Timestamp:: 2009-12-15 17:54:39
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 17:35:46 15 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-insertArraySize 10000
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: tfm_FinAcct
## Operator
transform
## Operator options
-flag run
-name 'V0S57_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinAcct'
## General options
[ident('tfm_FinAcct'); jobmon_ident('tfm_FinAcct')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
## Outputs
0> [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#### STAGE: LkpFinAcct.lnk_refFinAcct_Part
## Operator
entire
## General options
[ident('LkpFinAcct.lnk_refFinAcct_Part')]
## Inputs
0< [] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
## Outputs
0> [modify (
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME,
KHALIX_ACCT_CODE,FINANCE_ACCOUNT_CODE_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 41
Event ID: 40
Timestamp:: 2009-12-15 17:54:39
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 42
Event ID: 41
Timestamp:: 2009-12-15 17:54:39
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 43
Event ID: 42
Timestamp:: 2009-12-15 17:54:40
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 44
Event ID: 43
Timestamp:: 2009-12-15 17:54:40
Type: Info
User Name: dsadm
Message:: main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded

Item #: 45
Event ID: 44
Timestamp:: 2009-12-15 17:54:41
Type: Info
User Name: dsadm
Message:: main_program: -db_cs option is deprecated.

Item #: 46
Event ID: 45
Timestamp:: 2009-12-15 17:54:43
Type: Info
User Name: dsadm
Message:: main_program: -nchar_cs option is deprecated.

Item #: 47
Event ID: 46
Timestamp:: 2009-12-15 18:40:32
Type: Info
User Name: dsadm
Message:: main_program: APT configuration file: /etl/apps/DS/InformationServer/Server/Configurations/4node.apt
{
node "node1"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource scratchdisk "/data/scratch1" {pools ""}
}
node "node2"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource scratchdisk "/data/scratch2" {pools ""}
}
node "node3"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource scratchdisk "/data/scratch3" {pools ""}
}
node "node4"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource scratchdisk "/data/scratch4" {pools ""}
}
}

Item #: 48
Event ID: 47
Timestamp:: 2009-12-15 18:40:32
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,3: Records inserted: 0
Records used for update: 79,027
Records rejected: 477
Total records: 79504.

Item #: 49
Event ID: 48
Timestamp:: 2009-12-15 18:40:33
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,0: Records inserted: 0
Records used for update: 79,036
Records rejected: 469
Total records: 79505.

Item #: 50
Event ID: 49
Timestamp:: 2009-12-15 18:40:34
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,1: Records inserted: 0
Records used for update: 79,028
Records rejected: 476
Total records: 79504.

Item #: 51
Event ID: 50
Timestamp:: 2009-12-15 18:40:34
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,2: Records inserted: 0
Records used for update: 79,030
Records rejected: 474
Total records: 79504.

Item #: 52
Event ID: 51
Timestamp:: 2009-12-15 18:40:34
Type: Info
User Name: dsadm
Message:: scErr_ProdFinMap.seq_rejectFile,0: Export complete; 0 records exported successfully, 0 rejected.

Item #: 53
Event ID: 52
Timestamp:: 2009-12-15 18:40:34
Type: Info
User Name: dsadm
Message:: main_program: Step execution finished with status = OK.

Item #: 54
Event ID: 53
Timestamp:: 2009-12-15 18:40:34
Type: Info
User Name: dsadm
Message:: main_program: Startup time, 0:05; production run time, 45:48.

Item #: 55
Event ID: 54
Timestamp:: 2009-12-15 18:40:34
Type: Info
User Name: dsadm
Message:: Parallel job reports successful completion

Item #: 56
Event ID: 55
Timestamp:: 2009-12-15 18:40:36
Type: Control
User Name: dsadm
Message:: Finished Job CopyOfjbDrmEdwFinForecastProdMap.

Item #: 57
Event ID: 56
Timestamp:: 2009-12-16 16:08:21
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)
psCommon.p_JobGroupName = EDW_GROUP1 (Compiled-in default)
psCommon.p_JobRunSequenceID = 1 (Compiled-in default)
psCommon.p_SurrogateKeyDir = /data/surrogate/ (Compiled-in default)
psCommon.p_DatasetDir = /data/datasets/ (Compiled-in default)
psCommon.p_rejectDir = /data/reject/ (Compiled-in default)
psCommon.p_rejectFileSuffix = .dat (Compiled-in default)
psCommon.p_CreateUser = ETLADM (Compiled-in default)
psCommon.p_Update_User = ETLADM (Compiled-in default)
psCommon.p_InputFileDir = /data/inbound/manufacturing/ (Compiled-in default)
psCommon.p_DrmSrcFileDir = /data/inbound/drm/ (Compiled-in default)
psCommon.p_DrmArchiveDir = /data/archive/drm/ (Compiled-in default)
psCommon.p_JobGroupRunID = 1 (Compiled-in default)
psCommon.p_InboundDir = /data/inbound/ (Compiled-in default)
psCommon.p_RecepientMailID = rramesh@xxxxxx.com (Compiled-in default)
psCommon.p_SenderMailID = dsadm@xxxxxx.com (Compiled-in default)
psCommon.p_MailServer = tahoe.xxxxxx.com (Compiled-in default)
psCommon.p_ArchiveDir = /data/archive/quarterly/drm/ (Compiled-in default)
psCommon.p_KhalixFlatFileDir = /data/inbound/khalix/ (Compiled-in default)
psCommon.p_EndCustomerInboundDir = /data/inbound/endcustomer/ (Compiled-in default)
psCommon.p_EndCustomerOutboundDir = /data/outbound/endcustomer/ (Compiled-in default)
psEDWDB = (As pre-defined)
psEDWDB.p_EDWDSN = DEDWNI01 (Compiled-in default)
psEDWDB.p_DimsSchema = DIMS (Compiled-in default)
psEDWDB.p_EDWUser = ETLADM (Compiled-in default)
psEDWDB.p_EDWPasswd = ******** (Compiled-in default)
psEDWDB.p_FactsSchema = FACTS (Compiled-in default)
psEDWDB.p_AggrSchema = AGGR (Compiled-in default)
psEDWDB.p_Etl_Schema = ETL (Compiled-in default)
p_JobGroupRunID = 1
p_SourceSystemKey = 7
p_rejectFileName = jbDrmEdwProdFinMap

Item #: 58
Event ID: 57
Timestamp:: 2009-12-16 16:08:22
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-15509
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/xxxxxx/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/xxxxxx/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/xxxxxx/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/xxxxxx/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=16452
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/xxxxxx/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 59
Event ID: 58
Timestamp:: 2009-12-16 16:08:22
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 60
Event ID: 59
Timestamp:: 2009-12-16 16:08:22
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 16:08:08 16 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT \/*+ PARALLEL ([&"psEDWDB.p_DimsSchema"].PRODUCT,20) *\/ BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-insertArraySize 10000
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: tfm_FinAcct
## Operator
transform
## Operator options
-flag run
-name 'V0S57_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinAcct'
## General options
[ident('tfm_FinAcct'); jobmon_ident('tfm_FinAcct')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
## Outputs
0> [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#### STAGE: LkpFinAcct.lnk_refFinAcct_Part
## Operator
entire
## General options
[ident('LkpFinAcct.lnk_refFinAcct_Part')]
## Inputs
0< [] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
## Outputs
0> [modify (
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME,
KHALIX_ACCT_CODE,FINANCE_ACCOUNT_CODE_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 61
Event ID: 60
Timestamp:: 2009-12-16 16:08:22
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 62
Event ID: 61
Timestamp:: 2009-12-16 16:08:23
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 63
Event ID: 62
Timestamp:: 2009-12-16 16:08:24
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 64
Event ID: 63
Timestamp:: 2009-12-16 16:08:24
Type: Info
User Name: dsadm
Message:: main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded

Item #: 65
Event ID: 64
Timestamp:: 2009-12-16 16:08:25
Type: Info
User Name: dsadm
Message:: main_program: -db_cs option is deprecated.

Item #: 66
Event ID: 65
Timestamp:: 2009-12-16 16:08:29
Type: Info
User Name: dsadm
Message:: main_program: -nchar_cs option is deprecated.

Item #: 67
Event ID: 66
Timestamp:: 2009-12-16 17:39:59
Type: Info
User Name: dsadm
Message:: main_program: APT configuration file: /etl/apps/DS/InformationServer/Server/Configurations/4node.apt
{
node "node1"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource scratchdisk "/data/scratch1" {pools ""}
}
node "node2"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource scratchdisk "/data/scratch2" {pools ""}
}
node "node3"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource scratchdisk "/data/scratch3" {pools ""}
}
node "node4"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource scratchdisk "/data/scratch4" {pools ""}
}
}

Item #: 68
Event ID: 67
Timestamp:: 2009-12-16 17:40:00
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,1: Records inserted: 0
Records used for update: 79,028
Records rejected: 476
Total records: 79504.

Item #: 69
Event ID: 68
Timestamp:: 2009-12-16 17:40:01
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,3: Records inserted: 0
Records used for update: 79,027
Records rejected: 477
Total records: 79504.
Last edited by chpraveen.msc on Fri Dec 18, 2009 3:14 pm, edited 3 times in total.
chpraveen.msc
Participant
Posts: 26
Joined: Tue Nov 08, 2005 5:36 am

Post by chpraveen.msc »

Item #: 69
Event ID: 68
Timestamp:: 2009-12-16 17:40:01
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,3: Records inserted: 0
Records used for update: 79,027
Records rejected: 477
Total records: 79504.

Item #: 70
Event ID: 69
Timestamp:: 2009-12-16 17:40:05
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,0: Records inserted: 0
Records used for update: 79,036
Records rejected: 469
Total records: 79505.

Item #: 71
Event ID: 70
Timestamp:: 2009-12-16 17:40:05
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,2: Records inserted: 0
Records used for update: 79,030
Records rejected: 474
Total records: 79504.

Item #: 72
Event ID: 71
Timestamp:: 2009-12-16 17:40:05
Type: Info
User Name: dsadm
Message:: scErr_ProdFinMap.seq_rejectFile,0: Export complete; 0 records exported successfully, 0 rejected.

Item #: 73
Event ID: 72
Timestamp:: 2009-12-16 17:40:05
Type: Info
User Name: dsadm
Message:: main_program: Step execution finished with status = OK.

Item #: 74
Event ID: 73
Timestamp:: 2009-12-16 17:40:05
Type: Info
User Name: dsadm
Message:: main_program: Startup time, 0:08; production run time, 1:31:32.

Item #: 75
Event ID: 74
Timestamp:: 2009-12-16 17:40:05
Type: Info
User Name: dsadm
Message:: Parallel job reports successful completion

Item #: 76
Event ID: 75
Timestamp:: 2009-12-16 17:40:07
Type: Control
User Name: dsadm
Message:: Finished Job CopyOfjbDrmEdwFinForecastProdMap.

Item #: 77
Event ID: 76
Timestamp:: 2009-12-17 11:50:55
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)
psCommon.p_JobGroupName = EDW_GROUP1 (Compiled-in default)
psCommon.p_JobRunSequenceID = 1 (Compiled-in default)
psCommon.p_SurrogateKeyDir = /data/surrogate/ (Compiled-in default)
psCommon.p_DatasetDir = /data/datasets/ (Compiled-in default)
psCommon.p_rejectDir = /data/reject/ (Compiled-in default)
psCommon.p_rejectFileSuffix = .dat (Compiled-in default)
psCommon.p_CreateUser = ETLADM (Compiled-in default)
psCommon.p_Update_User = ETLADM (Compiled-in default)
psCommon.p_InputFileDir = /data/inbound/manufacturing/ (Compiled-in default)
psCommon.p_DrmSrcFileDir = /data/inbound/drm/ (Compiled-in default)
psCommon.p_DrmArchiveDir = /data/archive/drm/ (Compiled-in default)
psCommon.p_JobGroupRunID = 1 (Compiled-in default)
psCommon.p_InboundDir = /data/inbound/ (Compiled-in default)
psCommon.p_RecepientMailID = rramesh@netapp.com (Compiled-in default)
psCommon.p_SenderMailID = dsadm@netapp.com (Compiled-in default)
psCommon.p_MailServer = tahoe.netapp.com (Compiled-in default)
psCommon.p_ArchiveDir = /data/archive/quarterly/drm/ (Compiled-in default)
psCommon.p_KhalixFlatFileDir = /data/inbound/khalix/ (Compiled-in default)
psCommon.p_EndCustomerInboundDir = /data/inbound/endcustomer/ (Compiled-in default)
psCommon.p_EndCustomerOutboundDir = /data/outbound/endcustomer/ (Compiled-in default)
psEDWDB = (As pre-defined)
psEDWDB.p_EDWDSN = DEDWNI01 (Compiled-in default)
psEDWDB.p_DimsSchema = DIMS (Compiled-in default)
psEDWDB.p_EDWUser = ETLADM (Compiled-in default)
psEDWDB.p_EDWPasswd = ******** (Compiled-in default)
psEDWDB.p_FactsSchema = FACTS (Compiled-in default)
psEDWDB.p_AggrSchema = AGGR (Compiled-in default)
psEDWDB.p_Etl_Schema = ETL (Compiled-in default)
p_JobGroupRunID = 1
p_SourceSystemKey = 7
p_rejectFileName = jbDrmEdwProdFinMap

Item #: 78
Event ID: 77
Timestamp:: 2009-12-17 11:50:56
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-8441
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/netapp/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/netapp/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/netapp/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/netapp/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=27697
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/netapp/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 79
Event ID: 78
Timestamp:: 2009-12-17 11:50:56
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 80
Event ID: 79
Timestamp:: 2009-12-17 11:50:56
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 11:50:24 17 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT \/*+ PARALLEL ([&"psEDWDB.p_DimsSchema"].PRODUCT,20) *\/ BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: tfm_FinAcct
## Operator
transform
## Operator options
-flag run
-name 'V0S57_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinAcct'
## General options
[ident('tfm_FinAcct'); jobmon_ident('tfm_FinAcct')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
## Outputs
0> [] 'tfm_FinAcct:lnk_UI_FinProdMap.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#### STAGE: LkpFinAcct.lnk_refFinAcct_Part
## Operator
entire
## General options
[ident('LkpFinAcct.lnk_refFinAcct_Part')]
## Inputs
0< [] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
## Outputs
0> [modify (
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME,
KHALIX_ACCT_CODE,FINANCE_ACCOUNT_CODE_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 81
Event ID: 80
Timestamp:: 2009-12-17 11:50:56
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 82
Event ID: 81
Timestamp:: 2009-12-17 11:50:57
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 83
Event ID: 82
Timestamp:: 2009-12-17 11:50:57
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 84
Event ID: 83
Timestamp:: 2009-12-17 11:50:58
Type: Info
User Name: dsadm
Message:: main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded

Item #: 85
Event ID: 84
Timestamp:: 2009-12-17 11:50:59
Type: Info
User Name: dsadm
Message:: main_program: -db_cs option is deprecated.

Item #: 86
Event ID: 85
Timestamp:: 2009-12-17 11:51:01
Type: Info
User Name: dsadm
Message:: main_program: -nchar_cs option is deprecated.

Item #: 87
Event ID: 86
Timestamp:: 2009-12-17 12:03:27
Type: Info
User Name: dsadm
Message:: main_program: APT configuration file: /etl/apps/DS/InformationServer/Server/Configurations/4node.apt
{
node "node1"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource scratchdisk "/data/scratch1" {pools ""}
}
node "node2"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource scratchdisk "/data/scratch2" {pools ""}
}
node "node3"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource scratchdisk "/data/scratch3" {pools ""}
}
node "node4"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource scratchdisk "/data/scratch4" {pools ""}
}
}

Item #: 88
Event ID: 87
Timestamp:: 2009-12-17 12:03:27
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,0: Records inserted: 0
Records used for update: 79,036
Records rejected: 469
Total records: 79505.

Item #: 89
Event ID: 88
Timestamp:: 2009-12-17 12:03:27
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,3: Records inserted: 0
Records used for update: 79,027
Records rejected: 477
Total records: 79504.

Item #: 90
Event ID: 89
Timestamp:: 2009-12-17 12:03:32
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,1: Records inserted: 0
Records used for update: 79,028
Records rejected: 476
Total records: 79504.

Item #: 91
Event ID: 90
Timestamp:: 2009-12-17 12:03:32
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,2: Records inserted: 0
Records used for update: 79,030
Records rejected: 474
Total records: 79504.

Item #: 92
Event ID: 91
Timestamp:: 2009-12-17 12:03:32
Type: Info
User Name: dsadm
Message:: scErr_ProdFinMap.seq_rejectFile,0: Export complete; 0 records exported successfully, 0 rejected.

Item #: 93
Event ID: 92
Timestamp:: 2009-12-17 12:03:32
Type: Info
User Name: dsadm
Message:: main_program: Step execution finished with status = OK.

Item #: 94
Event ID: 93
Timestamp:: 2009-12-17 12:03:32
Type: Info
User Name: dsadm
Message:: main_program: Startup time, 0:06; production run time, 12:28.

Item #: 95
Event ID: 94
Timestamp:: 2009-12-17 12:03:33
Type: Info
User Name: dsadm
Message:: Parallel job reports successful completion

Item #: 96
Event ID: 95
Timestamp:: 2009-12-17 12:03:35
Type: Control
User Name: dsadm
Message:: Finished Job CopyOfjbDrmEdwFinForecastProdMap.

Item #: 97
Event ID: 96
Timestamp:: 2009-12-17 14:33:56
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)
psCommon.p_JobGroupName = EDW_GROUP1 (Compiled-in default)
psCommon.p_JobRunSequenceID = 1 (Compiled-in default)
psCommon.p_SurrogateKeyDir = /data/surrogate/ (Compiled-in default)
psCommon.p_DatasetDir = /data/datasets/ (Compiled-in default)
psCommon.p_rejectDir = /data/reject/ (Compiled-in default)
psCommon.p_rejectFileSuffix = .dat (Compiled-in default)
psCommon.p_CreateUser = ETLADM (Compiled-in default)
psCommon.p_Update_User = ETLADM (Compiled-in default)
psCommon.p_InputFileDir = /data/inbound/manufacturing/ (Compiled-in default)
psCommon.p_DrmSrcFileDir = /data/inbound/drm/ (Compiled-in default)
psCommon.p_DrmArchiveDir = /data/archive/drm/ (Compiled-in default)
psCommon.p_JobGroupRunID = 1 (Compiled-in default)
psCommon.p_InboundDir = /data/inbound/ (Compiled-in default)
psCommon.p_RecepientMailID = rramesh@netapp.com (Compiled-in default)
psCommon.p_SenderMailID = dsadm@netapp.com (Compiled-in default)
psCommon.p_MailServer = tahoe.netapp.com (Compiled-in default)
psCommon.p_ArchiveDir = /data/archive/quarterly/drm/ (Compiled-in default)
psCommon.p_KhalixFlatFileDir = /data/inbound/khalix/ (Compiled-in default)
psCommon.p_EndCustomerInboundDir = /data/inbound/endcustomer/ (Compiled-in default)
psCommon.p_EndCustomerOutboundDir = /data/outbound/endcustomer/ (Compiled-in default)
psEDWDB = (As pre-defined)
psEDWDB.p_EDWDSN = DEDWNI01 (Compiled-in default)
psEDWDB.p_DimsSchema = DIMS (Compiled-in default)
psEDWDB.p_EDWUser = ETLADM (Compiled-in default)
psEDWDB.p_EDWPasswd = ******** (Compiled-in default)
psEDWDB.p_FactsSchema = FACTS (Compiled-in default)
psEDWDB.p_AggrSchema = AGGR (Compiled-in default)
psEDWDB.p_Etl_Schema = ETL (Compiled-in default)
p_JobGroupRunID = 1
p_SourceSystemKey = 7
p_rejectFileName = jbDrmEdwProdFinMap

Item #: 98
Event ID: 97
Timestamp:: 2009-12-17 14:33:56
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-25917
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/netapp/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/netapp/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/netapp/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/netapp/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=27697
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/netapp/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 99
Event ID: 98
Timestamp:: 2009-12-17 14:33:56
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 100
Event ID: 99
Timestamp:: 2009-12-17 14:33:56
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 14:33:42 17 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT \/*+ PARALLEL ([&"psEDWDB.p_DimsSchema"].PRODUCT,20) *\/ BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#### STAGE: LkpFinAcct.lnk_refFinAcct_Part
## Operator
entire
## General options
[ident('LkpFinAcct.lnk_refFinAcct_Part')]
## Inputs
0< [] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [transfer(inputData renames KHALIX_ACCT_CODE as BK_FINANCE_ACCOUNT_CODE, PRODUCT_KEY as PRODUCT_AS_IS_KEY)] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
## Outputs
0> [modify (
keep
BK_FINANCE_ACCOUNT_CODE,FINANCE_ACCOUNT_CODE_KEY,BK_PART_NUMBER,PRODUCT_AS_IS_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [modify(KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;PRODUCT_KEY=PRODUCT_AS_IS_KEY;)] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 101
Event ID: 100
Timestamp:: 2009-12-17 14:33:56
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 102
Event ID: 101
Timestamp:: 2009-12-17 14:33:57
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 103
Event ID: 102
Timestamp:: 2009-12-17 14:33:57
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 104
Event ID: 103
Timestamp:: 2009-12-17 14:33:58
Type: Info
User Name: dsadm
Message:: main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded

Item #: 105
Event ID: 104
Timestamp:: 2009-12-17 14:33:58
Type: Info
User Name: dsadm
Message:: main_program: -db_cs option is deprecated.

Item #: 106
Event ID: 105
Timestamp:: 2009-12-17 14:34:00
Type: Info
User Name: dsadm
Message:: main_program: -nchar_cs option is deprecated.

Item #: 107
Event ID: 106
Timestamp:: 2009-12-17 14:43:51
Type: Info
User Name: dsadm
Message:: main_program: APT configuration file: /etl/apps/DS/InformationServer/Server/Configurations/4node.apt
{
node "node1"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource scratchdisk "/data/scratch1" {pools ""}
}
node "node2"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource scratchdisk "/data/scratch2" {pools ""}
}
node "node3"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node3" {pools ""}
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource scratchdisk "/data/scratch3" {pools ""}
}
node "node4"
{
fastname "svlcgsetl02-dev"
pools ""
resource disk "/data/node4" {pools ""}
resource disk "/data/node1" {pools ""}
resource disk "/data//node2" {pools ""}
resource disk "/data/node3" {pools ""}
resource scratchdisk "/data/scratch4" {pools ""}
}
}

Item #: 108
Event ID: 107
Timestamp:: 2009-12-17 14:43:58
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,0: Records inserted: 0
Records used for update: 79,036
Records rejected: 469
Total records: 79505.

Item #: 109
Event ID: 108
Timestamp:: 2009-12-17 14:44:10
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,3: Records inserted: 0
Records used for update: 79,027
Records rejected: 477
Total records: 79504.

Item #: 110
Event ID: 109
Timestamp:: 2009-12-17 14:44:21
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,2: Records inserted: 0
Records used for update: 79,030
Records rejected: 474
Total records: 79504.

Item #: 111
Event ID: 110
Timestamp:: 2009-12-17 14:44:21
Type: Info
User Name: dsadm
Message:: ora_Edw_FinProdMap,1: Records inserted: 0
Records used for update: 79,028
Records rejected: 476
Total records: 79504.

Item #: 112
Event ID: 111
Timestamp:: 2009-12-17 14:44:21
Type: Info
User Name: dsadm
Message:: scErr_ProdFinMap.seq_rejectFile,0: Export complete; 0 records exported successfully, 0 rejected.

Item #: 113
Event ID: 112
Timestamp:: 2009-12-17 14:44:21
Type: Info
User Name: dsadm
Message:: main_program: Step execution finished with status = OK.

Item #: 114
Event ID: 113
Timestamp:: 2009-12-17 14:44:21
Type: Info
User Name: dsadm
Message:: main_program: Startup time, 0:04; production run time, 10:19.

Item #: 115
Event ID: 114
Timestamp:: 2009-12-17 14:44:21
Type: Info
User Name: dsadm
Message:: Parallel job reports successful completion

Item #: 116
Event ID: 115
Timestamp:: 2009-12-17 14:44:23
Type: Control
User Name: dsadm
Message:: Finished Job CopyOfjbDrmEdwFinForecastProdMap.

Item #: 117
Event ID: 116
Timestamp:: 2009-12-17 16:56:13
Type: Info
User Name: dsadm
Message:: From previous run
DataStage Job 846 Phantom 25917
The variable "APT_PERFORMANCE_DATA" is not in the environment.
DataStage Phantom Finished.
Retrieve: syntax error. Unexpected symbol. Token was "@ID".
Scanned command was SELECT RT_LOG846 WITH @ID < AND @ID

Item #: 118
Event ID: 117
Timestamp:: 2009-12-17 16:56:14
Type: Control
User Name: dsadm
Message:: Starting Job CopyOfjbDrmEdwFinForecastProdMap.
psCommon = (As pre-defined)
psCommon.p_JobGroupName = EDW_GROUP1 (Compiled-in default)
psCommon.p_JobRunSequenceID = 1 (Compiled-in default)
psCommon.p_SurrogateKeyDir = /data/surrogate/ (Compiled-in default)
psCommon.p_DatasetDir = /data/datasets/ (Compiled-in default)
psCommon.p_rejectDir = /data/reject/ (Compiled-in default)
psCommon.p_rejectFileSuffix = .dat (Compiled-in default)
psCommon.p_CreateUser = ETLADM (Compiled-in default)
psCommon.p_Update_User = ETLADM (Compiled-in default)
psCommon.p_InputFileDir = /data/inbound/manufacturing/ (Compiled-in default)
psCommon.p_DrmSrcFileDir = /data/inbound/drm/ (Compiled-in default)
psCommon.p_DrmArchiveDir = /data/archive/drm/ (Compiled-in default)
psCommon.p_JobGroupRunID = 1 (Compiled-in default)
psCommon.p_InboundDir = /data/inbound/ (Compiled-in default)
psCommon.p_RecepientMailID = rramesh@netapp.com (Compiled-in default)
psCommon.p_SenderMailID = dsadm@netapp.com (Compiled-in default)
psCommon.p_MailServer = tahoe.netapp.com (Compiled-in default)
psCommon.p_ArchiveDir = /data/archive/quarterly/drm/ (Compiled-in default)
psCommon.p_KhalixFlatFileDir = /data/inbound/khalix/ (Compiled-in default)
psCommon.p_EndCustomerInboundDir = /data/inbound/endcustomer/ (Compiled-in default)
psCommon.p_EndCustomerOutboundDir = /data/outbound/endcustomer/ (Compiled-in default)
psEDWDB = (As pre-defined)
psEDWDB.p_EDWDSN = DEDWNI01 (Compiled-in default)
psEDWDB.p_DimsSchema = DIMS (Compiled-in default)
psEDWDB.p_EDWUser = ETLADM (Compiled-in default)
psEDWDB.p_EDWPasswd = ******** (Compiled-in default)
psEDWDB.p_FactsSchema = FACTS (Compiled-in default)
psEDWDB.p_AggrSchema = AGGR (Compiled-in default)
psEDWDB.p_Etl_Schema = ETL (Compiled-in default)
p_JobGroupRunID = 1
p_SourceSystemKey = 7
p_rejectFileName = jbDrmEdwProdFinMap

Item #: 119
Event ID: 118
Timestamp:: 2009-12-17 16:56:15
Type: Info
User Name: dsadm
Message:: Environment variable settings:


APT_COMPILEOPT=-dalign -O -PIC -library=iostream -c
APT_COMPILER=/opt/SUNWspro/bin/CC
APT_CONFIG_FILE=/etl/apps/DS/InformationServer/Server/Configurations/4node.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_LINKER=/opt/SUNWspro/bin/CC
APT_LINKOPT=-G -library=iostream
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop
APT_ORCHHOME=/etl/apps/DS/InformationServer/Server/PXEngine
ASBHOME=/etl/apps/DS/InformationServer/ASBNode
BELL=^G
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-938
DSHOME=/etl/apps/DS/InformationServer/Server/DSEngine
DSIPC_OPEN_TIMEOUT=30
DSPROJ=/etl/apps/DS/InformationServer/Server/Projects
DSSAPHOME=/etl/apps/DS/InformationServer/Server
FLAVOR=-1
HOME=/
HZ=
LC_ALL=en_US.UTF-8
LC_COLLATE=en_US.ISO8859-1
LC_CTYPE=en_US.ISO8859-1
LC_MESSAGES=C
LC_MONETARY=en_US.ISO8859-1
LC_NUMERIC=en_US.ISO8859-1
LD_LIBRARY_PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_lib:/etl/apps/DS/InformationServer/Server/PXEngine/lib:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc/client:/etl/apps/DS/InformationServer/ASBNode/apps/jre/lib/sparc:/etl/apps/DS/InformationServer/ASBNode/lib/cpp:/etl/apps/DS/InformationServer/ASBNode/apps/proxy/cpp/sunos-all-sparc:/etl/apps/DS/InformationServer/Server/branded_odbc/lib:/etl/apps/DS/InformationServer/Server/DSEngine/lib:/etl/apps/DS/InformationServer/Server/DSEngine/uvdlls:/netapp/oracle/product/10.2/lib32:/usr/lib:/lib
LOGNAME=dsadm
MAIL=/var/mail/root
MANPATH=/usr/man:
NLS_LANG=AMERICAN_AMERICA.UTF8
ODBCINI=/etl/apps/DS/InformationServer/Server/DSEngine/.odbc.ini
ORACLE_HOME=/netapp/oracle/product/10.2
OSH_STDOUT_MSG=1
PATH=/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/wrapped:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/buildop:/etl/apps/DS/InformationServer/Server/Projects/ERR_FRAMEWRK/RT_BP846.O:/etl/apps/DS/InformationServer/Server/DSComponents/lib:/etl/apps/DS/InformationServer/Server/DSComponents/bin:/etl/apps/DS/InformationServer/Server/DSParallel:/etl/apps/DS/InformationServer/Server/PXEngine/user_osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/osh_wrappers:/etl/apps/DS/InformationServer/Server/PXEngine/bin:/sbin:/usr/sbin:/usr/ccs/bin:/usr/local/bin:/netapp/oracle/product/10.2/bin:/etl/apps/DS/InformationServer/Server/DSEngine/bin:/usr/sbin:/netapp/oracle/product/9.2.0.1/ocommon/nls:/bin:/opt/SUNWspro/bin:/usr/bin
PIDTOK=27697
PWD=.
PX_DBCONNECTHOME=/etl/apps/DS/InformationServer/Server/DSComponents
SHELL=/sbin/sh
TERM=
TNS_ADMIN=/netapp/oracle/10_2
TZ=US/Pacific
UDTBIN=/etl/apps/DS/InformationServer/Server/DSEngine/ud41/bin
UDTHOME=/etl/apps/DS/InformationServer/Server/DSEngine/ud41
WHO=ERR_FRAMEWRK

Item #: 120
Event ID: 119
Timestamp:: 2009-12-17 16:56:15
Type: Info
User Name: dsadm
Message:: Parallel job initiated

Item #: 121
Event ID: 120
Timestamp:: 2009-12-17 16:56:15
Type: Info
User Name: dsadm
Message:: OSH script
# OSH / orchestrate script for Job CopyOfjbDrmEdwFinForecastProdMap compiled at 14:33:42 17 DEC 2009
#################################################################
#### STAGE: tfm_GetValues
## Operator
transform
## Operator options
-flag run
-name 'V0S2_scErrorReportingCommon_tfm_GetValues'
## General options
[ident('scErr_ProdFinMap.tfm_GetValues'); jobmon_ident('scErr_ProdFinMap.tfm_GetValues')]
## Inputs
0< [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
## Outputs
0> [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: seq_rejectFile
## Operator
export
## Operator options
-schema record
{final_delim=end, delim=',', quote=double}
(
ETL_Job_Name:string[max=60];
ETL_Job_Group_ID:int32;
Reject_DateTime:timestamp;
RejectErrorCode:string[max=1000];
Reject_Record1:string[max=4000];
)
-file '[&"psCommon.p_rejectDir"][&"p_rejectFileName"][&"psCommon.p_rejectFileSuffix"]'
-overwrite
-rejects continue
-firstLineColumnNames
## General options
[ident('scErr_ProdFinMap.seq_rejectFile'); jobmon_ident('scErr_ProdFinMap.seq_rejectFile')]
## Inputs
0< [] 'scErr_ProdFinMap:tfm_GetValues:lnk_WriteToFile.v'
;
#################################################################
#### STAGE: ora_Edw_Product
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT \/*+ PARALLEL ([&"psEDWDB.p_DimsSchema"].PRODUCT,20) *\/ BK_PART_NUMBER, PRODUCT_KEY, PRODUCT_FAMILY_NAME, PRODUCT_REVENUE_CLASS_NAME FROM [&"psEDWDB.p_DimsSchema"].PRODUCT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_Product'); jobmon_ident('ora_Edw_Product')]
## Outputs
0> [modify (
BK_PART_NUMBER:nullable string[max=50]=BK_PART_NUMBER;
PRODUCT_KEY:not_nullable decimal[38,10]=PRODUCT_KEY;
PRODUCT_FAMILY_NAME:nullable string[max=300]=PRODUCT_FAMILY_NAME;
PRODUCT_REVENUE_CLASS_NAME:nullable string[max=300]=PRODUCT_REVENUE_CLASS_NAME;
keep
BK_PART_NUMBER,PRODUCT_KEY,PRODUCT_FAMILY_NAME,PRODUCT_REVENUE_CLASS_NAME;
)] 'ora_Edw_Product:lnk_readEdwProduct.v'
;
#################################################################
#### STAGE: ora_Edw_FinProdMap
## Operator
oraupsert
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-insert 'INSERT INTO [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP (BK_FINANCE_ACCOUNT_CODE, FINANCE_ACCOUNT_CODE_KEY, BK_PART_NUMBER, PRODUCT_AS_IS_KEY) VALUES (ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY, ORCHESTRATE.BK_PART_NUMBER, ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-update 'UPDATE [&"psEDWDB.p_DimsSchema"].FINANCE_FORECAST_PRODUCT_MAP SET BK_FINANCE_ACCOUNT_CODE = ORCHESTRATE.BK_FINANCE_ACCOUNT_CODE, BK_PART_NUMBER = ORCHESTRATE.BK_PART_NUMBER WHERE (FINANCE_ACCOUNT_CODE_KEY = ORCHESTRATE.FINANCE_ACCOUNT_CODE_KEY AND PRODUCT_AS_IS_KEY = ORCHESTRATE.PRODUCT_AS_IS_KEY)'
-server '[&"psEDWDB.p_EDWDSN"]'
## General options
[ident('ora_Edw_FinProdMap'); jobmon_ident('ora_Edw_FinProdMap')]
## Inputs
0< [] 'LkpFinAcct:lnk_SetUI.v'
;
#################################################################
#### STAGE: set_Acct
## Operator
transform
## Operator options
-flag run
-name 'V0S59_CopyOfjbDrmEdwFinForecastProdMap_set_Acct'
## General options
[ident('set_Acct'); jobmon_ident('set_Acct')]
## Inputs
0< [] 'ora_Edw_Product:lnk_readEdwProduct.v'
## Outputs
0> [] 'set_Acct:lnk_LkpFinAcct.v'
;
#### STAGE: LkpFinAcct.lnk_refFinAcct_Part
## Operator
entire
## General options
[ident('LkpFinAcct.lnk_refFinAcct_Part')]
## Inputs
0< [] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
## Outputs
0> [] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
;
#################################################################
#### STAGE: LkpFinAcct
## Operator
lookup
## Operator options
-table
-key KHALIX_ACCT_CODE
-ifNotFound reject
## General options
[ident('LkpFinAcct'); jobmon_ident('LkpFinAcct')]
## Inputs
0< [transfer(inputData renames KHALIX_ACCT_CODE as BK_FINANCE_ACCOUNT_CODE, PRODUCT_KEY as PRODUCT_AS_IS_KEY)] 'set_Acct:lnk_LkpFinAcct.v'
1< [view (
KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct_Part.v'
## Outputs
0> [modify (
keep
BK_FINANCE_ACCOUNT_CODE,FINANCE_ACCOUNT_CODE_KEY,BK_PART_NUMBER,PRODUCT_AS_IS_KEY;)] 'LkpFinAcct:lnk_SetUI.v'
1> [modify(KHALIX_ACCT_CODE=BK_FINANCE_ACCOUNT_CODE;PRODUCT_KEY=PRODUCT_AS_IS_KEY;)] 'LkpFinAcct:lnk_tfmErr.v'
;
#################################################################
#### STAGE: ora_Edw_FinAcct
## Operator
oraread
## Operator options
-nchar_cs [&DSProjectMapName]
-db_cs [&DSProjectMapName]
-dboptions '{user=[&"psEDWDB.p_EDWUser"],password=[&"psEDWDB.p_EDWPasswd"]}'
-query 'SELECT FINANCE_ACCOUNT_CODE_KEY, BK_FINANCE_ACCOUNT_CODE FROM [&"psEDWDB.p_DimsSchema"].FINANCE_ACCOUNT'
-server '[&"psEDWDB.p_EDWDSN"]'
-use_strings
## General options
[ident('ora_Edw_FinAcct'); jobmon_ident('ora_Edw_FinAcct')]
## Outputs
0> [modify (
FINANCE_ACCOUNT_CODE_KEY:not_nullable decimal[38,10]=FINANCE_ACCOUNT_CODE_KEY;
BK_FINANCE_ACCOUNT_CODE:nullable string[max=50]=BK_FINANCE_ACCOUNT_CODE;
keep
FINANCE_ACCOUNT_CODE_KEY,BK_FINANCE_ACCOUNT_CODE;
)] 'ora_Edw_FinAcct:lnk_refFinAcct.v'
;
#################################################################
#### STAGE: tfm_FinRej
## Operator
transform
## Operator options
-flag run
-name 'V57S0_CopyOfjbDrmEdwFinForecastProdMap_tfm_FinRej'
-argvalue 'p_JobGroupRunID=[&"p_JobGroupRunID"]'
## General options
[ident('tfm_FinRej'); jobmon_ident('tfm_FinRej')]
## Inputs
0< [] 'LkpFinAcct:lnk_tfmErr.v'
## Outputs
0> [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: scErr_ProdFinMap INPUT LINK: lnk_scRejectFinAcctCode
## Operator
copy
## General options
[ident('scErr_ProdFinMap.lnk_scRejectFinAcctCode')]
## Inputs
0< [] 'tfm_FinRej:lnk_scRejectFinAcctCode.v'
## Outputs
0> [] 'scErr_ProdFinMap:Container:lnk_readInput.v'
;
# End of OSH code

Item #: 122
Event ID: 121
Timestamp:: 2009-12-17 16:56:15
Type: Info
User Name: dsadm
Message:: Parallel job default NLS map UTF-8, default locale OFF

Item #: 123
Event ID: 122
Timestamp:: 2009-12-17 16:56:17
Type: Info
User Name: dsadm
Message:: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4665
Copyright (c) 2001, 2005-2007 IBM Corporation. All rights reserved

Item #: 124
Event ID: 123
Timestamp:: 2009-12-17 16:56:18
Type: Info
User Name: dsadm
Message:: main_program: The open files limit is 100; raising to 65536.

Item #: 125
Event ID: 124
Timestamp:: 2009-12-17 16:56:18
Type: Info
User Name: dsadm
Message:: main_program: orchstats: loaded

Item #: 126
Event ID: 125
Timestamp:: 2009-12-17 16:56:18
Type: Fatal
User Name: dsadm
Message:: main_program: Unexpected tokens: -f RT_SC846/OshScript.osh -pf RT_SC846/jpfile -impexp_charset UTF-8 .

Item #: 127
Event ID: 126
Timestamp:: 2009-12-17 16:56:18
Type: Fatal
User Name: dsadm
Message:: main_program: Failing to create a step.

Item #: 128
Event ID: 127
Timestamp:: 2009-12-17 16:56:18
Type: Fatal
User Name: dsadm
Message:: main_program: Orchresest error: Parsing OSH job failed.

Item #: 129
Event ID: 128
Timestamp:: 2009-12-17 16:56:23
Type: Control
User Name: dsadm
Message:: Job CopyOfjbDrmEdwFinForecastProdMap aborted.

End of report.
Post Reply