Orphan OSH.exe

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
wjfitzgerald
Participant
Posts: 72
Joined: Tue Feb 05, 2008 4:38 am

Orphan OSH.exe

Post by wjfitzgerald »

Hi,

I have a number of jobs running in a loop for quite a while at this stage. In recent days they have started to hang regularly, but never consistently on the same job.

The job starts as normal and the first few lines in the log look perfectly normal. then nothing!

The only way I can restart the loop successfully is to stop the offending job. Stop the DS services, delete all remaining OSH.exe threads, restart the services, recompile the job and then restart the loop.

As there are no code changes I am assuming this is an environmental/ resources issue?

I have had a look through the forum, and there is one posting on OSH.exe which I have read. There are a number of other postings which might be related but I am just not sure of all the terms.

Could some body give me a quick idiots guide to what I am looking at, or a guide to determining the issue, please?

Thank you as always,
Regards,

John Fitz
Top
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Can you give us a better idea about what kind of jobs we're talking about here, design function etc? And while I can guess what 'running in a loop for quite a while' means, but I'd rather not.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Top
wjfitzgerald
Participant
Posts: 72
Joined: Tue Feb 05, 2008 4:38 am

Post by wjfitzgerald »

Hi,

I have four levels of job. The high level is a very simple loop which call a sequence job, this job in turn calls a number of process jobs in a strict order. Each of these process jobs move a nujmber of text files to a particular folder, call an xml job to read these input files and finally move the files to a done folder to avoid reprocessing. the XML job is final job, which as mentioned, reads the iput file and produces an xml message which it places on a MQ Queue.

It is always the XML job which appears to stop processing.

Is there some way to see which OSH.exe is linked to which job?
I assume that each .exe should complete it's task and then be removed.

THanks,

JOhn FItz
John Fitz
Top
wjfitzgerald
Participant
Posts: 72
Joined: Tue Feb 05, 2008 4:38 am

Post by wjfitzgerald »

Hi,

Still struggling with this, i am posting the log entries from the latest job failure in the hope it might mean something to someone.

As always, i appreciate any helo you might be able to offer.

Thanks,
John Fitz

Starting Job NK_Card_XML.
WJF_Parameters = (As pre-defined)
WJF_Parameters.$MQQNameTP11 = WJFB.WJF.TRANSACTIONS.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameEmp = WJFB.WJF.CUSTOMERACCOUNT.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameCardAcct = WJFB.WJF.CUSTOMERACCOUNT.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameCard = WJFB.WJF.CUSTOMERACCOUNT.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameAI = WJFB.WJF.CUSTOMERACCOUNT.MSGOUT (Compiled-in default)
WJF_Parameters.$ZuserMqCnt = 5 (Compiled-in default)
WJF_Parameters.$TP11MqCnt = 5 (Compiled-in default)
WJF_Parameters.$CardMqCnt = 5 (Compiled-in default)
WJF_Parameters.$CardAcctMqCnt = 5 (Compiled-in default)
WJF_Parameters.$AIMqCnt = 5 (Compiled-in default)
WJF_Parameters.$TransMqCnt = 5 (Compiled-in default)
WJF_Parameters.$AcctMqCnt = 5 (Compiled-in default)
WJF_Parameters.$INI_File = E:\IBM\WJF_Data\AML_Parameter_Prod.ini (Compiled-in default)
WJF_Parameters.$CacctMqCnt = 5 (Compiled-in default)
WJF_Parameters.$SwiftMqCnt = 5 (Compiled-in default)
WJF_Parameters.$Environment = P (Compiled-in default)
WJF_Parameters.$Qmanager = PNT3589 (Compiled-in default)
WJF_Parameters.$MQUser = Europa\MQ3697 (Compiled-in default)
WJF_Parameters.$MQQNameT = WJFB.WJF.TRANSACTIONS.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameS = WJFB.WJF.TRANSACTIONS.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameC = WJFB.WJF.CUSTOMERACCOUNT.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQNameA = WJFB.WJF.CUSTOMERACCOUNT.MSGOUT (Compiled-in default)
WJF_Parameters.$MQQName = WJF.UNIBANKS.MSGOUT (Compiled-in default)
WJF_Parameters.$MQPassword = ******** (Compiled-in default)
WJF_Parameters.$MQCONN = SERV3589(1414) (Compiled-in default)
WJF_Parameters.$MQChannel = SYSTEM.DEF.SVRCONN (Compiled-in default)
WJF_Parameters.$Password = ******** (Compiled-in default)
WJF_Parameters.$Id = sa (Compiled-in default)
WJF_Parameters.$DataBase = ETL (Compiled-in default)
DSJobController = Process_KCARD


--------------------------------------------------------------------------

09/09/2009 15:10:29
Environment variable settings:
AcctMqCnt=5
AIMqCnt=5
ALLUSERSPROFILE=C:\Documents and Settings\All Users
APT_COMPILEOPT=-W/TP -W/EHa -DAPT_USE_ANSI_IOSTREAMS -c -W/Zc:wchar_t-
APT_COMPILER=cxx
APT_CONFIG_FILE=E:/IBM/InformationServer/Server/Configurations/default.apt
APT_ERROR_CONFIGURATION=severity, !vseverity, !jobid, moduleid, errorIndex, timestamp, !ipaddr, !nodeplayer, !nodename, opid, message
APT_IMPORT_PATTERN_USES_FILESET=1
APT_LINKER=cxx
APT_LINKOPT=-s -W/dll -W/base:0x50000000 -W/Zc:wchar_t-
APT_MONITOR_MINTIME=10
APT_OPERATOR_REGISTRY_PATH=E:\IBM\InformationServer\Server\Projects\WJF\buildop
APT_ORCHHOME=E:/IBM/InformationServer/Server/PXEngine
APT_USE_CRLF=1
BELL=^G
CacctMqCnt=5
CardAcctMqCnt=5
CardMqCnt=5
ClusterLog=C:\WINDOWS\Cluster\cluster.log
COMPUTERNAME=SERV3697
CommonProgramFiles=C:\Program Files\Common Files
ComSpec=C:\WINDOWS\system32\cmd.exe
DataBase=ETL
DEFLOGDIR=C:\Documents and Settings\All Users\Application Data\McAfee\DesktopProtection
DISPLAY=:0.0
DS_ENABLE_RESERVED_CHAR_CONVERT=0
DS_OPERATOR_BUILDOP_DIR=buildop
DS_OPERATOR_WRAPPED_DIR=wrapped
DS_TDM_PIPE_OPEN_TIMEOUT=720
DS_TDM_TRACE_SUBROUTINE_CALLS=0
DS_USERNO=-17620
DSIPC_OPEN_TIMEOUT=30
EMCPATH=C:\Program Files\EMC\EDMBackup\Program
Environment=P
FLAVOR=-1
FP_NO_HOST_CHECK=NO
Id=sa
INCLUDE=C:\Program Files\Microsoft Platform SDK for Windows Server 2003 R2\Include
INI_File=E:\IBM\WJF_Data\AML_Parameter_Prod.ini
LIB=C:\Program Files\Microsoft Platform SDK for Windows Server 2003 R2\Lib
MAN_CHM_INDEX=C:/PROGRA~1/MKSTOO~1/etc/chm/tkutil.idx;C:/PROGRA~1/MKSTOO~1/etc/chm/tkapi.idx;C:/PROGRA~1/MKSTOO~1/etc/chm/tcltk.idx;C:/PROGRA~1/MKSTOO~1/etc/chm/tkcurses.idx
MAN_HTM_PATHS=C:/PROGRA~1/MKSTOO~1/etc/htm/perl;C:/PROGRA~1/MKSTOO~1/etc/htm/perl/pod;C:/PROGRA~1/MKSTOO~1/etc/htm/perl/ext;C:/PROGRA~1/MKSTOO~1/etc/htm/perl/lib
MAN_TXT_INDEX=C:/PROGRA~1/MKSTOO~1/etc/tkutil.idx;C:/PROGRA~1/MKSTOO~1/etc/tkapi.idx;C:/PROGRA~1/MKSTOO~1/etc/tcltk.idx;C:/PROGRA~1/MKSTOO~1/etc/tkcurses.idx
MQChannel=SYSTEM.DEF.SVRCONN
MQCONN=SERV3589(1414)
MQFT_JAVA_LIB_PATH=E:\Program Files\IBM\WebSphere MQ\java\lib
MQFT_JRE_BIN_PATH=C:\Program Files\IBM\Eclipse SDK30eclipse\jre\bin
MQPassword=LEH@9KRHN=3O4N7M49J40KAD
MQQName=WJF.UNIBANKS.MSGOUT
MQQNameA=WJFB.WJF.CUSTOMERACCOUNT.MSGOUT
MQQNameAI=WJFB.WJF.CUSTOMERACCOUNT.MSGOUT
MQQNameC=WJFB.WJF.CUSTOMERACCOUNT.MSGOUT
MQQNameCard=WJFB.WJF.CUSTOMERACCOUNT.MSGOUT
MQQNameCardAcct=WJFB.WJF.CUSTOMERACCOUNT.MSGOUT
MQQNameEmp=WJFB.WJF.CUSTOMERACCOUNT.MSGOUT
MQQNameS=WJFB.WJF.TRANSACTIONS.MSGOUT
MQQNameT=WJFB.WJF.TRANSACTIONS.MSGOUT
MQQNameTP11=WJFB.WJF.TRANSACTIONS.MSGOUT
MQUser=Europa\MQ3697
NUMBER_OF_PROCESSORS=16
NUTCROOT=C:\PROGRA~1\MKSTOO~1
OS=Windows_NT
OSH_STDOUT_MSG=1
PATH=E:\IBM\InformationServer\Server\PXEngine\bin;E:\IBM\InformationServer\Server\PXEngine\osh_wrappers;E:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;E:\IBM\InformationServer\Server\PXEngine\user_osh_wrappers;E:\IBM\InformationServer\Server\DSComponents\bin;E:\IBM\InformationServer\Server\DSParallel;E:\IBM\InformationServer\Server\Projects\WJF\RT_BP127.O;E:\IBM\InformationServer\Server\DSEngine\bin;E:\IBM\InformationServer\Server\Projects\WJF\buildop;E:\IBM\InformationServer\Server\Projects\WJF\wrapped;C:\PROGRA~1\MKSTOO~1\bin;C:\PROGRA~1\MKSTOO~1\bin\X11;C:\PROGRA~1\MKSTOO~1\mksnt;E:\IBM\InformationServer\ASBNode\lib\cpp;E:\IBM\InformationServer\ASBNode\apps\proxy\cpp\vc60\MT_dll\bin;C:\Program Files\HP\NCU;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\Microsoft Platform SDK for Windows Server 2003 R2\Lib;C:\Program Files\Microsoft SQL Server\80\Tools\Binn\;E:\IBM\InformationServer\Clients\Classic;C:\Program Files\EMC\EDMBackup\Program;E:\Program Files\IBM\WebSphere MQ\bin;C:\Program Files\System Center Operations Manager 2007\;C:\Program Files\Indicative\agents\tools\WINNT\itb\Bin;
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.sh;.ksh;.csh;.sed;.awk;.pl
Password=LE:@1IVH?9:=4OFM48J4AKAF
PIDTOK=28856
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_IDENTIFIER=x86 Family 15 Model 4 Stepping 8, GenuineIntel
PROCESSOR_LEVEL=15
PROCESSOR_REVISION=0408
ProgramFiles=C:\Program Files
PWD=E:\IBM\InformationServer\Server\Projects\WJF
PX_DBCONNECTHOME=E:/IBM/InformationServer/Server/DSComponents
Qmanager=PNT3589
ROOTDIR=C:/PROGRA~1/MKSTOO~1
SHELL=C:/PROGRA~1/MKSTOO~1/mksnt/sh.exe
SwiftMqCnt=5
SystemDrive=C:
SystemRoot=C:\WINDOWS
TEMP=C:\WINDOWS\TEMP
TERM=console
TERMCAP=C:\PROGRA~1\MKSTOO~1\etc\termcap
TERMINFO=C:\PROGRA~1\MKSTOO~1\usr\lib\terminfo
TMP=C:\WINDOWS\TEMP
TP11MqCnt=5
TransMqCnt=5
UNIVERSE_CONTROLLING_TERM=1
UNIVERSE_PARENT_PROCESS=10064
USER=EUROPA\SERV3697
USERPROFILE=C:\Documents and Settings\Default User
VS80COMNTOOLS=C:\Program Files\Microsoft Visual Studio 8\Common7\Tools\
VSEDEFLOGDIR=C:\Documents and Settings\All Users\Application Data\McAfee\DesktopProtection
WHO=WJF
windir=C:\WINDOWS
ZuserMqCnt=5

---------------------------------------------------------------------------------
09/09/2009 15:10:29
Parallel job initiated
---------------------------------------------------------------------------------

09/09/2009 15:10:29
OSH script
# OSH / orchestrate script for Job NK_Card_XML compiled at 16:42:55 13 AUG 2009
#################################################################
#### STAGE: TR_Cdata
## Operator
transform
## Operator options
-flag run
-name 'V36S3_SCXMLCard_TR_Cdata'
## General options
[ident('SCXMLCard.TR_Cdata'); jobmon_ident('SCXMLCard.TR_Cdata')]
## Inputs
0< [] 'SCXMLCard:XML_Card:Lnk_Cdata.v'
## Outputs
0> [] 'SCXMLCard:TR_Cdata:lnk_file.v'
;
#################################################################
#### STAGE: XML_Card
## Operator
dsplugin
## Operator options
-charset [&DSProjectMapName]
-stageprops NK_Card_XML.XML_Card '{
generate_full_document=1,
multi_line_output=1,
indentation_character=\'\\\\s\',
indentation_length=2,
include_header=0,
include_namespaces=0,
generate_comment=1,
include_document=0,
include_xml_chunk=0,
replace_nulls=0,
discard_empty_values=0,
xml_encoding=\'UTF\-8\',
validate_output=0,
enable_grammar_caching=0,
xml_validation_level=0,
log_reject_errors=0
}'
-inlinkprops 0 lnk_ToXML '{
DSTxnSize=0,
DSDescription={Id=\'\/Message\/Id\', Type=\'\/Message\/Type\', Sequence=\'\/Message\/Sequence\', CARD_ID=\'\/Message\/Data\/txn\/CARD_ID\', PRIMARY_CUSTOMER_CIF_KEY=\'\/Message\/Data\/txn\/PRIMARY_CUSTOMER_CIF_KEY\', CARD_TYPE=\'\/Message\/Data\/txn\/CARD_TYPE\', ISSUING_BANK_CODE=\'\/Message\/Data\/txn\/ISSUING_BANK_CODE\', ISSUE_DATE=\'\/Message\/Data\/txn\/ISSUE_DATE\', EXPIRY_DATE=\'\/Message\/Data\/txn\/EXPIRY_DATE\', SEQUENCE_NUMBER=\'\/Message\/Data\/txn\/SEQUENCE_NUMBER\', CVV_VERIFY=\'\/Message\/Data\/txn\/CVV_VERIFY\', LANGUAGE_PREFERENCE_CODE=\'\/Message\/Data\/txn\/LANGUAGE_PREFERENCE_CODE\', CARD_STATUS=\'\/Message\/Data\/txn\/CARD_STATUS\', CARD_STATUS_CHANGED_TIMESTAMP=\'\/Message\/Data\/txn\/CARD_STATUS_CHANGED_TIMESTAMP\', PIN_CHANGED_TIMESTAMP=\'\/Message\/Data\/txn\/PIN_CHANGED_TIMESTAMP\', LAST_UPDATED_TIMESTAMP=\'\/Message\/Data\/txn\/LAST_UPDATED_TIMESTAMP\', CARD_HOLDER_NAME=\'\/Message\/Data\/txn\/CARD_HOLDER_NAME\', CARD_HOLDER_TITLE=\'\/Message\/Data\/txn\/CARD_HOLDER_TITLE\', CARD_HOLDER_FIRST_NAME=\'\/Message\/Data\/txn\/CARD_HOLDER_FIRST_NAME\', CARD_HOLDER_LAST_NAME=\'\/Message\/Data\/txn\/CARD_HOLDER_LAST_NAME\', LIMIT_AMOUNT=\'\/Message\/Data\/txn\/LIMIT_AMOUNT\', LIMIT_AMOUNT_CHANGED_TIMESTAMP=\'\/Message\/Data\/txn\/LIMIT_AMOUNT_CHANGED_TIMESTAMP\', REGISTRATION_CHANGED_TIMESTAMP=\'\/Message\/Data\/txn\/REGISTRATION_CHANGED_TIMESTAMP\', TO_TIMESTAMP=\'\/Message\/Data\/txn\/TO_TIMESTAMP\', FROM_TIMESTAMP=\'\/Message\/Data\/txn\/FROM_TIMESTAMP\', TELLER_ID=\'\/Message\/Data\/txn\/TELLER_ID\'},
DSIsKey={card_no=1},
DSDisplayWidth={Id=255, Type=255, Sequence=255, CARD_ID=255, PRIMARY_CUSTOMER_CIF_KEY=255, CARD_TYPE=255, ISSUING_BANK_CODE=255, ISSUE_DATE=255, EXPIRY_DATE=255, SEQUENCE_NUMBER=255, CVV_VERIFY=255, LANGUAGE_PREFERENCE_CODE=255, CARD_STATUS=255, CARD_STATUS_CHANGED_TIMESTAMP=255, PIN_CHANGED_TIMESTAMP=255, LAST_UPDATED_TIMESTAMP=255, CARD_HOLDER_NAME=255, CARD_HOLDER_TITLE=255, CARD_HOLDER_FIRST_NAME=255, CARD_HOLDER_LAST_NAME=255, LIMIT_AMOUNT=255, LIMIT_AMOUNT_CHANGED_TIMESTAMP=255, REGISTRATION_CHANGED_TIMESTAMP=255, TO_TIMESTAMP=255, FROM_TIMESTAMP=255, TELLER_ID=255},
DSSQLType={TransactionTS=11, card_no=1, Id=12, Type=12, Sequence=12, CARD_ID=12, PRIMARY_CUSTOMER_CIF_KEY=12, CARD_TYPE=12, ISSUING_BANK_CODE=12, ISSUE_DATE=12, EXPIRY_DATE=12, SEQUENCE_NUMBER=12, CVV_VERIFY=12, LANGUAGE_PREFERENCE_CODE=12, CARD_STATUS=12, CARD_STATUS_CHANGED_TIMESTAMP=12, PIN_CHANGED_TIMESTAMP=12, LAST_UPDATED_TIMESTAMP=12, CARD_HOLDER_NAME=12, CARD_HOLDER_TITLE=12, CARD_HOLDER_FIRST_NAME=12, CARD_HOLDER_LAST_NAME=12, LIMIT_AMOUNT=12, LIMIT_AMOUNT_CHANGED_TIMESTAMP=12, REGISTRATION_CHANGED_TIMESTAMP=12, TO_TIMESTAMP=12, FROM_TIMESTAMP=12, TELLER_ID=12},
DSSQLPrecision={card_no=16, Id=255, Type=255, Sequence=255, CARD_ID=255, PRIMARY_CUSTOMER_CIF_KEY=255, CARD_TYPE=255, ISSUING_BANK_CODE=255, ISSUE_DATE=255, EXPIRY_DATE=255, SEQUENCE_NUMBER=255, CVV_VERIFY=255, LANGUAGE_PREFERENCE_CODE=255, CARD_STATUS=255, CARD_STATUS_CHANGED_TIMESTAMP=255, PIN_CHANGED_TIMESTAMP=255, LAST_UPDATED_TIMESTAMP=255, CARD_HOLDER_NAME=255, CARD_HOLDER_TITLE=255, CARD_HOLDER_FIRST_NAME=255, CARD_HOLDER_LAST_NAME=255, LIMIT_AMOUNT=255, LIMIT_AMOUNT_CHANGED_TIMESTAMP=255, REGISTRATION_CHANGED_TIMESTAMP=255, TO_TIMESTAMP=255, FROM_TIMESTAMP=255, TELLER_ID=255},
DSSchema=\'record
(
TransactionTS\:timestamp\;
card_no\:string\[16\]\;
Id\:string\[max\=255\]\;
Type\:string\[max\=255\]\;
Sequence\:string\[max\=255\]\;
CARD_ID\:string\[max\=255\]\;
PRIMARY_CUSTOMER_CIF_KEY\:string\[max\=255\]\;
CARD_TYPE\:string\[max\=255\]\;
ISSUING_BANK_CODE\:string\[max\=255\]\;
ISSUE_DATE\:string\[max\=255\]\;
EXPIRY_DATE\:string\[max\=255\]\;
SEQUENCE_NUMBER\:string\[max\=255\]\;
CVV_VERIFY\:string\[max\=255\]\;
LANGUAGE_PREFERENCE_CODE\:string\[max\=255\]\;
CARD_STATUS\:string\[max\=255\]\;
CARD_STATUS_CHANGED_TIMESTAMP\:string\[max\=255\]\;
PIN_CHANGED_TIMESTAMP\:string\[max\=255\]\;
LAST_UPDATED_TIMESTAMP\:string\[max\=255\]\;
CARD_HOLDER_NAME\:string\[max\=255\]\;
CARD_HOLDER_TITLE\:string\[max\=255\]\;
CARD_HOLDER_FIRST_NAME\:string\[max\=255\]\;
CARD_HOLDER_LAST_NAME\:string\[max\=255\]\;
LIMIT_AMOUNT\:string\[max\=255\]\;
LIMIT_AMOUNT_CHANGED_TIMESTAMP\:string\[max\=255\]\;
REGISTRATION_CHANGED_TIMESTAMP\:string\[max\=255\]\;
TO_TIMESTAMP\:string\[max\=255\]\;
FROM_TIMESTAMP\:string\[max\=255\]\;
TELLER_ID\:string\[max\=255\]\;
)\'
}'
-outlinkprops 0 Lnk_Cdata '{
generate_full_document=1,
multi_line_output=0,
indentation_character=\'\\\\s\',
indentation_length=2,
new_line_style=\'DOS\',
include_header=0,
include_namespaces=0,
generate_comment=1,
include_document=0,
include_xml_chunk=0,
replace_nulls=0,
discard_empty_values=0,
empty_element_style=\'use open\/close tags\',
output_row_generation=\'all rows\',
xml_encoding=\'UTF\-8\',
inherit_properties=0,
is_reject_link=0,
DSDescription={Data=\'\/\'},
DSSQLType={Data=12, TransactionTS=11, card_no=1},
DSSQLPrecision={Data=9999, card_no=16},
DSSchema=\'record
(
Data\:string\[max\=9999\]\;
TransactionTS\:timestamp\;
card_no\:string\[16\]\;
)\'
}'
-rtlib 'xmlo.dll'
-reslib 'xmloenu.dll'
## General options
[ident('SCXMLCard.XML_Card'); jobmon_ident('SCXMLCard.XML_Card'); par]
## Inputs
0< [] 'SCXMLCard:TR_Data_Prep:lnk_ToXML.v'
## Outputs
0> [] 'SCXMLCard:XML_Card:Lnk_Cdata.v'
;
#################################################################
#### STAGE: TR_Data_Prep
## Operator
transform
## Operator options
-flag run
-name 'V36S0_SCXMLCard_TR_Data_Prep'
## General options
[ident('SCXMLCard.TR_Data_Prep'); jobmon_ident('SCXMLCard.TR_Data_Prep')]
## Inputs
0< [] 'SCXMLCard:SCXMLCard:lnk_Data_Prep.v'
## Outputs
0> [] 'SCXMLCard:TR_Data_Prep:lnk_ToXML.v'
;
#################################################################
#### STAGE: Lu_Kcard
## Operator
sqlsrvrlookup
## Operator options
-db_cs [&DSProjectMapName]
-data_source '[&"WJF_Parameters.$DataBase"]'
-user '[&"WJF_Parameters.$Id"]'
-password '[&"WJF_Parameters.$Password"]'
-query 'select kcard_card_no as card_no, kcust_cust_no as cust_no, kcard_c_type as card_typ,
cust_title as title, cust_firstname as firstname, cust_surname as surname,
kcard_status as card_stat,kcard_embname as emb_name,
convert(varchar,kcard_issue_date,103) as issue_dte,
convert(varchar,kcard_expdate,103) as expiry_dte,
convert(varchar,kcard_pin_reiss,103) as pin_reissue_dte,bcard_indic
from kcard, kcust,cust,bcard
where kcard_card_no = ORCHESTRATE.card_no
and kcard_card_no = kcust_card_no
and kcust_cust_no = cust_cust_no
and kcard_c_type = bcard_c_type
order by 1,2'
-use_strings
-ifNotFound continue
## General options
[ident('Lu_Kcard'); jobmon_ident('Lu_Kcard')]
## Inputs
0< [transfer( inRec excludes card_no)] 'FI_action:lnk_ToKcardLkp.v'
## Outputs
0> [modify (
card_no:not_nullable string[16]=card_no;
cust_no:nullable int64=cust_no;
card_typ:nullable int32=card_typ;
card_stat:nullable string[1]=card_stat;
emb_name:nullable string[max=27]=emb_name;
issue_dte:nullable string[max=30]=issue_dte;
expiry_dte:nullable string[max=30]=expiry_dte;
pin_reissue_dte:nullable string[max=30]=pin_reissue_dte;
title:nullable string[max=8]=title;
firstname:nullable string[max=15]=firstname;
surname:nullable string[max=60]=surname;
bcard_indic:nullable string[1]=bcard_indic;
keep
TransactionTS,card_no,cust_no,card_typ,
card_stat,emb_name,issue_dte,expiry_dte,
pin_reissue_dte,title,firstname,surname,
bcard_indic;)] 'Lu_Kcard:DSLink83.v'
;
#################################################################
#### STAGE: Peek_MQ
## Operator
peek
## Operator options
-name
-nrecs 5
## General options
[ident('Peek_MQ'); jobmon_ident('Peek_MQ')]
## Inputs
0< [] 'SCXMLCard:lnk_file.v'
## Outputs
0> [modify (
keep
Data;
)] 'Peek_MQ:DSLink31.v'
;
#################################################################
#### STAGE: MQ_Card
## Operator
pxbridge
## Operator options
-XMLProperties '<?xml version=\'1.0\' encoding=\'UTF-16\'?><Properties version=\'1.0\'><Common><Context type=\'int\'>2</Context><Variant type=\'string\'>5.3</Variant><DescriptorVersion type=\'string\'>1.0</DescriptorVersion><PartitionType type=\'int\'>0</PartitionType></Common><Connection><Mode modified=\'1\' type=\'int\'><![CDATA[1]]></Mode><QueueManagerName type=\'string\'><![CDATA[[&"WJF_Parameters.$Qmanager"]]]></QueueManagerName><Username modified=\'1\' type=\'string\'><![CDATA[[&"WJF_Parameters.$MQUser"]]]></Username><Password modified=\'1\' type=\'string\'><![CDATA[[&"WJF_Parameters.$MQPassword"]]]></Password><ClientChannelDefinition><ChannelName type=\'string\'><![CDATA[[&"WJF_Parameters.$MQChannel"]]]></ChannelName><TransportType modified=\'1\' type=\'int\'><![CDATA[2]]></TransportType><ConnectionName type=\'string\'><![CDATA[[&"WJF_Parameters.$MQCONN"]]]></ConnectionName></ClientChannelDefinition></Connection><Usage><QueueName type=\'string\'><![CDATA[[&"WJF_Parameters.$MQQNameCard"]]]></QueueName><SQL collapsed=\'1\'></SQL><ContextMode modified=\'1\' type=\'int\'><![CDATA[0]]></ContextMode><OtherQueueSettings collapsed=\'1\' type=\'bool\'><![CDATA[0]]></OtherQueueSettings><MessageWriteMode type=\'int\'><![CDATA[1]]></MessageWriteMode><Transaction><RecordCount type=\'int\'><![CDATA[[&"WJF_Parameters.$CardMqCnt"]]]></RecordCount></Transaction><MessageOptions collapsed=\'1\' type=\'bool\'><![CDATA[0]]></MessageOptions><ErrorQueue collapsed=\'1\' type=\'bool\'><![CDATA[0]]></ErrorQueue><HeaderFieldsSetter modified=\'1\' type=\'bool\'><![CDATA[1]]><Version type=\'int\'><![CDATA[2]]></Version><MsgType><SystemValue type=\'int\'><![CDATA[8]]></SystemValue></MsgType><Expiry type=\'int\'><![CDATA[-1]]></Expiry><Feedback><SystemValue type=\'int\'><![CDATA[0]]></SystemValue></Feedback><Encoding type=\'int\'><![CDATA[-1]]></Encoding><CodedCharSetId modified=\'1\' type=\'int\'><![CDATA[1208]]></CodedCharSetId><Format><SystemValue type=\'int\'><![CDATA[16]]></SystemValue></Format><Priority type=\'int\'><![CDATA[-1]]></Priority><Persistence type=\'int\'><![CDATA[2]]></Persistence><MsgId><Hex type=\'bool\'><![CDATA[0]]></Hex></MsgId><CorrelId><Hex type=\'bool\'><![CDATA[0]]></Hex></CorrelId><GroupId><Hex type=\'bool\'><![CDATA[0]]></Hex></GroupId><MsgSeqNumber type=\'int\'><![CDATA[1]]></MsgSeqNumber><Offset type=\'int\'><![CDATA[0]]></Offset></HeaderFieldsSetter><PubSub collapsed=\'1\' type=\'bool\'><![CDATA[0]]></PubSub></Usage></Properties >'
-connector '{
variant=5.3,
library=ccwsmq,
version=1.0,
variantlist='5.3',
versionlist='1.0',
name=WebSphereMQConnector
}'
-target 0 '{
DSDescription={Data=\'\/\'},
DSSQLType={Data=12},
DSDerivation={Data=\'lnk_file\.Data\'},
DSSQLPrecision={Data=9999},
DSSchema=\'record
(
Data\:string\[max\=9999\]\;
)\'
}'

## General options
[ident('MQ_Card'); jobmon_ident('MQ_Card')]
## Inputs
0< [] 'Peek_MQ:DSLink31.v'
;
#################################################################
#### STAGE: FI_action
## Operator
filter
## Operator options
-where 'Action =\'U\' and (OCARD_NO <> NCARD_NO or OC_TYPE <> NC_TYPE or OISSUE_DATE <> NISSUE_DATE or OEXPDATE <> NEXPDATE or OSTATUS <> NSTATUS or OPIN_REISS <> NPIN_REISS or OEMBNAME <> NEMBNAME)'
-target 0
-where 'Action =\'I\''
-target 0
## General options
[ident('FI_action'); jobmon_ident('FI_action')]
## Inputs
0< [] 'Sq_Kcard:lnk_Filter.v'
## Outputs
0> [modify (
card_no:string[16]=NCARD_NO;
keep
TransactionTS,Field002,Action,Field004;
)] 'FI_action:lnk_ToKcardLkp.v'
;
#################################################################
#### STAGE: Sq_Kcard
## Operator
import
## Operator options
-schema record
{final_delim=end, record_delim='\n', delim=',', quote=double}
(
TransactionTS:timestamp;
Field002:string[1];
Action:string[1];
Field004:string;
OCARD_NO:string[max=16];
OMAINT:string[max=255];
OACC_CARD:string[max=255];
OATM_ET:string[max=255];
OCAPTDATE:string[max=255];
OCAPTREAS:string[max=255];
OCHRG_IND:string[max=255];
OCTIME:string[max=255];
OEMBNAME:string[max=255];
OFFORMAT:string[max=255];
OHCF_UPD:string[max=255];
OKUPDATE:string[max=255];
ONEW_CRD:string[max=255];
OORDER:string[max=255];
OORDER_TYPE:string[max=255];
OPOSTTOCUST:string[max=255];
OREGN_REQD:string[max=255];
OREISSUE:string[max=255];
OSIG_SCAN:string[max=255];
OSTATUS:string[max=255];
OTOLD_TPII:string[max=255];
OVISAPM:string[max=255];
OAMOUNT:string[max=255];
OAMOUNT_DT:string[max=255];
OAMOUNT1:string[max=255];
OAMOUNT2:string[max=255];
OAMOUNT3:string[max=255];
OAMOUNT4:string[max=255];
OAMOUNT5:string[max=255];
OANVDATE:string[max=255];
OBALIMIT1:string[max=255];
OBALIMIT2:string[max=255];
OBALIMIT3:string[max=255];
OBALIMIT4:string[max=255];
OBALIMIT5:string[max=255];
OC_TYPE:string[max=255];
OCANCELDATE:string[max=255];
OCAPDTE:string[max=255];
OCSTATE:string[max=255];
OC1:string[max=255];
OC2:string[max=255];
OC3:string[max=255];
OC4:string[max=255];
OC5:string[max=255];
ODAYNO:string[max=255];
ODEP_TOT:string[max=255];
ODEPCNT:string[max=255];
ODTLSTTRN:string[max=255];
OEXPDATE:string[max=255];
OIMAGE_NO:string[max=255];
OINET_ACTIV:string[max=255];
OISSUE_DATE:string[max=255];
OLST_PDATE:string[max=255];
ONO_OF_ACC:string[max=255];
OORDER_DATE:string[max=255];
OPIN_OFFSET:string[max=255];
OPIN_REISS:string[max=255];
OPINDATE:string[max=255];
OPOS_LEN:string[max=255];
OPOS_LIM:string[max=255];
OPOS_STI:string[max=255];
OPOSTDTE:string[max=255];
OPRDATE:string[max=255];
OPSN:string[max=255];
OREGN_NO:string[max=255];
OSTI_LIM:string[max=255];
OSTOLENDATE:string[max=255];
OTELE_ACTIV:string[max=255];
OTELE_REG:string[max=255];
OTIME8:string[max=255];
OT2_OFFSET:string[max=255];
OUPDATE_LCK:string[max=255];
OWDL_LEN:string[max=255];
OWDL_LIM:string[max=255];
OWDL_TOT:string[max=255];
OWDLCNT:string[max=255];
NCARD_NO:string[max=16];
NMAINT:string[max=255];
NACC_CARD:string[max=255];
NATM_ET:string[max=255];
NCAPTDATE:string[max=255];
NCAPTREAS:string[max=255];
NCHRG_IND:string[max=255];
NCTIME:string[max=255];
NEMBNAME:string[max=255];
NFFORMAT:string[max=255];
NHCF_UPD:string[max=255];
NKUPDATE:string[max=255];
NNEW_CRD:string[max=255];
NORDER:string[max=255];
NORDER_TYPE:string[max=255];
NPOSTTOCUST:string[max=255];
NREGN_REQD:string[max=255];
NREISSUE:string[max=255];
NSIG_SCAN:string[max=255];
NSTATUS:string[max=255];
NTOLD_TPII:string[max=255];
NVISAPM:string[max=255];
NAMOUNT:string[max=255];
NAMOUNT_DT:string[max=255];
NAMOUNT1:string[max=255];
NAMOUNT2:string[max=255];
NAMOUNT3:string[max=255];
NAMOUNT4:string[max=255];
NAMOUNT5:string[max=255];
NANVDATE:string[max=255];
NBALIMIT1:string[max=255];
NBALIMIT2:string[max=255];
NBALIMIT3:string[max=255];
NBALIMIT4:string[max=255];
NBALIMIT5:string[max=255];
NC_TYPE:string[max=255];
NCANCELDATE:string[max=255];
NCAPDTE:string[max=255];
NCSTATE:string[max=255];
NC1:string[max=255];
NC2:string[max=255];
NC3:string[max=255];
NC4:string[max=255];
NC5:string[max=255];
NDAYNO:string[max=255];
NDEP_TOT:string[max=255];
NDEPCNT:string[max=255];
NDTLSTTRN:string[max=255];
NEXPDATE:string[max=255];
NIMAGE_NO:string[max=255];
NINET_ACTIV:string[max=255];
NISSUE_DATE:string[max=255];
NLST_PDATE:string[max=255];
NNO_OF_ACC:string[max=255];
NORDER_DATE:string[max=255];
NPIN_OFFSET:string[max=255];
NPIN_REISS:string[max=255];
NPINDATE:string[max=255];
NPOS_LEN:string[max=255];
NPOS_LIM:string[max=255];
NPOS_STI:string[max=255];
NPOSTDTE:string[max=255];
NPRDATE:string[max=255];
NPSN:string[max=255];
NREGN_NO:string[max=255];
NSTI_LIM:string[max=255];
NSTOLENDATE:string[max=255];
NTELE_ACTIV:string[max=255];
NTELE_REG:string[max=255];
NTIME8:string[max=255];
NT2_OFFSET:string[max=255];
NUPDATE_LCK:string[max=255];
NWDL_LEN:string[max=255];
NWDL_LIM:string[max=255];
NWDL_TOT:string[max=255];
NWDLCNT:string[max=255];
)
-rejects continue
-reportProgress yes
-filepattern 'E:/IBM/WJF_Data/[&"WJF_Parameters.$Environment"]/To_Do/KCARD.*'
## General options
[ident('Sq_Kcard'); jobmon_ident('Sq_Kcard')]
## Outputs
0> [] 'Sq_Kcard:lnk_Filter.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: SCXMLCard INPUT LINK: lnk_Data_Prep
## Operator
copy
## General options
[ident('SCXMLCard.lnk_Data_Prep')]
## Inputs
0< [] 'FI_Online_Cards:lnk_Data_Prep.v'
## Outputs
0> [] 'SCXMLCard:SCXMLCard:lnk_Data_Prep.v'
;
#################################################################
#### CONTAINER MAPPING - CONTAINER STAGE: SCXMLCard OUTPUT LINK: lnk_file
## Operator
copy
## General options
[ident('SCXMLCard.lnk_file')]
## Inputs
0< [] 'SCXMLCard:TR_Cdata:lnk_file.v'
## Outputs
0> [modify (
keep
TransactionTS,card_no,Data;
)] 'SCXMLCard:lnk_file.v'
;
#################################################################
#### STAGE: FI_Online_Cards
## Operator
filter
## Operator options
-where 'bcard_indic <> \'O\' and cust_no <> 99999991'
## General options
[ident('FI_Online_Cards'); jobmon_ident('FI_Online_Cards')]
## Inputs
0< [] 'Lu_Kcard:DSLink83.v'
## Outputs
0> [modify (
keep
TransactionTS,card_no,cust_no,card_typ,
card_stat,emb_name,issue_dte,expiry_dte,
pin_reissue_dte,title,firstname,surname;
)] 'FI_Online_Cards:lnk_Data_Prep.v'
;
# End of OSH code

------------------------------------------------------------------------------
09/09/2009 15:10:29
Parallel job default NLS map ASCL_MS1252, default locale OFF

------------------------------------------------------------------------------

10/09/2009 08:35:53
main_program:
--------------------------------------------------------------------------------


10/09/2009 08:35:53
Parallel job was aborted
Top
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:
Contact ArndW

Post by ArndW »

The OSH looks normal. Can you add $APT_STARTUP_STATUS, APT_PM_PLAYER_TIMING, APT_PM_SHOW_PIDS to your job? With the PIDs you can use "truss" to see which process might be doing more than just issuing calls to sleep?
Top
wjfitzgerald
Participant
Posts: 72
Joined: Tue Feb 05, 2008 4:38 am

Post by wjfitzgerald »

ArndW

Will do, i'll come back with the details after the next fail.

Regards,

John FItz
John Fitz
Top
wjfitzgerald
Participant
Posts: 72
Joined: Tue Feb 05, 2008 4:38 am

Post by wjfitzgerald »

Hi,

So the jobs failed again. Again the fail has occurred on the KCARD job, however when i check the PID of the remaining osh.exe processess against the listings in the logs, most of the PIDs refer to the previous xml job - Transaction. The transaction job has finished with the following log entries:

10/09/2009 19:17:16
main_program: Releasing Section Leaders; parallel step time was 5.5 seconds.
-----------------------------
10/09/2009 19:17:16
main_program: Returning step status of APT_StatusOk.
--------------------------------
10/09/2009 19:17:16
main_program: Step execution finished with status = OK.
--------------------------------
10/09/2009 19:17:17
main_program: Startup time, 0:06; production run time, 0:05.
--------------------------------
10/09/2009 19:17:17
Parallel job reports successful completion
--------------------------------
10/09/2009 19:17:17
Finished Job NK_Transaction_DM.
--------------------------------
10/09/2009 19:17:17
(Process_Transaction) <- NK_Transaction_DM: Job under control finished.
--------------------------------

Obviously of course the releasing of the section numbers does not seem to have worked.

Is there any action i can take to force the release?
John Fitz
Top
wjfitzgerald
Participant
Posts: 72
Joined: Tue Feb 05, 2008 4:38 am

Post by wjfitzgerald »

Hi,

Not sure if this means anything but just in case ....

When i am clearing out the outstanding PID's, there is always one that once you clear all the remaining ones remove themselves.

With this last issue the PID that did this was the following:
APT_CombinedOperatorController,4: APT_PMPlayer: new Player running, PID = 18520

I have no idea what this means, so as usual if some one could point me in the right direction i'd really appreciate it.
John Fitz
Top
Post Reply

Return to “IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)”