main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded
main_program: Returning step status of APT_StatusOk.
main_program: Could not check all operators because of previous error(s) [api/step_rep.C:1144]
(There is no previous error mentioned in the log)
main_program: Creation of a step finished with status = FAILED. [osh.C:1112]
What can be the cause of the problem and how to diagnose it?
Thanks in advance,
Ajith
Could not check all operators
Moderators: chulett, rschirm, roy
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Not possible with the small amount of information you've provided. Describe your job design more fully. Inspect (post?) the generated OSH. Try dumping the score, to see exactly what will be run.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
I dumped the score
Log looked like this;
main_program: Max inbound connections per node = 1
Max outbound connections per node = 1
main_program: Defining Section Leaders.
main_program: Contacting Section Leaders.
main_program: Broadcasting score.
main_program: Score (9,371 bytes) sent.
main_program: Starting Players.
main_program: Waiting for Players to start.
main_program: Setting up data connections among Players.
main_program: Starting step execution.
main_program: Waiting for step completion.
main_program: Releasing Section Leaders; parallel step time was 0.004 seconds.
main_program: Returning step status of APT_StatusOk.
main_program: Explanation:
Step has 15 operators.
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( CODE_TYPE: string[35]; CODE: string[20]; DESC: string[255]; DATA_SRC_CD: string[2]; ROW_END_DT: string[8]; ) -file /uss/landing/USS300.EXT.Code_Feed.monthly.dat -rejects continue -reportProgress yes
output port 0 bound to data entity "ActvSetStsCodeFeed_seq:ToDataSrcModify.v"
???, invoked with args: -where DATA_SRC_CD =89
input port 0 bound to data entity "ActvSetStsCodeFeed_seq:ToDataSrcModify.v"
output port 0 bound to data entity "ActvSetStsDataSrc_flt:ToCodeFeedLkp.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( ACTV_SET_STS_RSN_STG_KEY: string[8]; ACTV_SET_STS_RSN_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; SRC_ACTV_SET_STS_RSN_CD: string[20]; SRC_ACTV_SET_STS_RSN_DESC: string[255]; DATA_SRC_CD: string[2]; ADD_DT: string[8]; MOD_DT: string[8]; ROW_EFF_DT: string[8]; ROW_END_DT: string[8]; ) -file /uss/unittest/optum/load/UUSS315.LOAD.Code_Stg.ActvRsn.Upd.monthly.load -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToActvSetStsUpdt.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( SRC_CODE: string[20]; SRC_DESC: string[255]; STD_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; DATA_SRC_CD: string[2]; ) -file /uss/landing/MANUAL_ACTIVITY_SET_STATUS_REASON.dat -rejects continue -reportProgress yes
output port 0 bound to data entity "ActvSetStsManFeed_mod:ToManFeedLkp.v"
???, invoked with args: -flag run -name V0S16_USS315StgOpOSAvSetStsRsn_Test_ActvSetStsSrcDescChk_tran
input port 0 bound to data entity "ActvSetStsManFeed_lkp:ToSrcDescChkTrans.v"
output port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToSrcDescReject.v"
output port 1 bound to data entity "ActvSetStsSrcDescChk_tran:ToSurKeyGen.v"
output port 2 bound to data entity "ActvSetStsSrcDescChk_tran:ToActvSetStsUpdt.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( CODE: string[20]; CODE_TYPE: string[35]; DESC: string[255]; DATA_SRC_CD: string[2]; ) -file /uss/unittest/optum/load/USS315.DSINT.Code_Stg.ActvRsn.ERR.monthly.err -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToSrcDescReject.v"
???, invoked with args: -schema record ( ACTV_SET_STS_RSN_STG_KEY: int32 {cycle={init="1+part", incr=partcount}}; )
input port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToSurKeyGen.v"
output port 0 bound to data entity "ActvSetSts_SurKeyGen:ToHighestKeyCopy.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( ACTV_SET_STS_RSN_STG_KEY: string[8]; ACTV_SET_STS_RSN_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; SRC_ACTV_SET_STS_RSN_CD: string[20]; SRC_ACTV_SET_STS_RSN_DESC: string[255]; DATA_SRC_CD: string[2]; ADD_DT: string[8]; MOD_DT: string[8]; ROW_EFF_DT: string[8]; ROW_END_DT: string[8]; ) -file /uss/unittest/optum/reject/USS315.DSINT.Code_Stg.ActvRsn.SKey.ERR.monthly.err -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsIns_flt:ToSurKeyOverflowReject.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( TABLE_NAME: string[20]; ACTV_SET_STS_RSN_STG_KEY: nullable dfloat; ) -file /uss/unittest/optum/input/USS315.DSINT.Code_Stg.ActvRsn.SKey.monthly.dat -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsHighestSurKey_agg:ToHighestSurKey.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( ACTV_SET_STS_RSN_STG_KEY: string[8]; ACTV_SET_STS_RSN_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; SRC_ACTV_SET_STS_RSN_CD: string[20]; SRC_ACTV_SET_STS_RSN_DESC: string[255]; DATA_SRC_CD: string[2]; ADD_DT: string[8]; MOD_DT: string[8]; ROW_EFF_DT: string[8]; ROW_END_DT: string[8]; ) -file //uss/unittest/optum/load/USS315.LOAD.Code_Stg.ActvRsn.Ins.monthly.load -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsIns_flt:ToActvSetStsInsert.v"
???, invoked with args: -table -key CODE -ifNotFound continue
input port 0 bound to data entity "ActvSetStsDataSrc_flt:ToCodeFeedLkp.v"
input port 1 bound to data entity "ActvSetStsStagingTable_mod:ToCodFeedLkp.v"
output port 0 bound to data entity "ActvSetStsCodefeed_lkp:ToManualFeedLkp.v"
???, invoked with args: -table -key CODE -key DESC -keep -key DATA_SRC_CD -ifNotFound continue
input port 0 bound to data entity "ActvSetStsCodefeed_lkp:ToManualFeedLkp.v"
input port 1 bound to data entity "ActvSetStsManFeed_mod:ToManFeedLkp.v"
output port 0 bound to data entity "ActvSetStsManFeed_lkp:ToSrcDescChkTrans.v"
???, invoked with args: -where ACTV_SET_STS_RSN_STG_KEY<100000000 -target 1 -where ACTV_SET_STS_RSN_STG_KEY>99999999 -target 0 -where ACTV_SET_STS_RSN_STG_KEY<100000000 -target 2
input port 0 bound to data entity "ActvSetSts_SurKeyGen:ToHighestKeyCopy.v"
output port 0 bound to data entity "ActvSetStsIns_flt:ToSurKeyOverflowReject.v"
output port 1 bound to data entity "ActvSetStsIns_flt:ToActvSetStsInsert.v"
output port 2 bound to data entity "ActvSetStsIns_flt:ToHighestKeyAgg.v"
???, invoked with args: -hash -key TABLE_NAME -reduce ACTV_SET_STS_RSN_STG_KEY -max ACTV_SET_STS_RSN_STG_KEY
input port 0 bound to data entity "ActvSetStsIns_flt:ToHighestKeyAgg.v"
output port 0 bound to data entity "ActvSetStsHighestSurKey_agg:ToHighestSurKey.v"
???, invoked with args: -schema record {record_delim="\n", delim=","} ( ACTV_SET_STS_RSN_STG_KEY: int32; SRC_ACTV_SET_STS_RSN_CD: string[max=20]; SRC_ACTV_SET_STS_RSN_DESC: string[max=255]; ACTV_SET_STS_RSN_DESC: string[max=255]; ACTV_SET_STS_RSN_CTGY_DESC: string[max=255]; DATA_SRC_CD: int32; ROW_END_DT: string[8]; MOD_DT: string[8]; ) -file /uss/unittest/optum/input/ACTV_SET_STS_STG_RSN.dat -rejects continue -reportProgress yes
output port 0 bound to data entity "ActvSetStsStagingTable_mod:ToCodFeedLkp.v"
Step has 14 data entities.
Data "ActvSetStsCodeFeed_seq:ToDataSrcModify.v"(an Orchestrate data set)
written by operator "ActvSetStsCodeFeed_seq"
read by operator "ActvSetStsDataSrc_flt"
Data "ActvSetStsDataSrc_flt:ToCodeFeedLkp.v"(an Orchestrate data set)
written by operator "ActvSetStsDataSrc_flt"
read by operator "ActvSetStsCodefeed_lkp"
Data "ActvSetStsSrcDescChk_tran:ToActvSetStsUpdt.v"(an Orchestrate data set)
written by operator "ActvSetStsSrcDescChk_tran"
read by operator "ActvSetStsUpd_seq"
Data "ActvSetStsManFeed_lkp:ToSrcDescChkTrans.v"(an Orchestrate data set)
written by operator "ActvSetStsManFeed_lkp"
read by operator "ActvSetStsSrcDescChk_tran"
Data "ActvSetStsSrcDescChk_tran:ToSrcDescReject.v"(an Orchestrate data set)
written by operator "ActvSetStsSrcDescChk_tran"
read by operator "ActvSetStsSrcDescRej_seq"
Data "ActvSetStsSrcDescChk_tran:ToSurKeyGen.v"(an Orchestrate data set)
written by operator "ActvSetStsSrcDescChk_tran"
read by operator "ActvSetSts_SurKeyGen"
Data "ActvSetSts_SurKeyGen:ToHighestKeyCopy.v"(an Orchestrate data set)
written by operator "ActvSetSts_SurKeyGen"
read by operator "ActvSetStsIns_flt"
Data "ActvSetStsIns_flt:ToSurKeyOverflowReject.v"(an Orchestrate data set)
written by operator "ActvSetStsIns_flt"
read by operator "ActvSetStsSurKeyOverFlowRej_seq"
Data "ActvSetStsHighestSurKey_agg:ToHighestSurKey.v"(an Orchestrate data set)
written by operator "ActvSetStsHighestSurKey_agg"
read by operator "ActvSetStsHighestSurKey_seq"
Data "ActvSetStsIns_flt:ToActvSetStsInsert.v"(an Orchestrate data set)
written by operator "ActvSetStsIns_flt"
read by operator "ActvSetStsIns_seq"
Data "ActvSetStsManFeed_mod:ToManFeedLkp.v"(an Orchestrate data set)
written by operator "ActvSetStsManFeed_seq"
read by operator "ActvSetStsManFeed_lkp"
Data "ActvSetStsStagingTable_mod:ToCodFeedLkp.v"(an Orchestrate data set)
written by operator "Sequential_File_98"
read by operator "ActvSetStsCodefeed_lkp"
Data "ActvSetStsCodefeed_lkp:ToManualFeedLkp.v"(an Orchestrate data set)
written by operator "ActvSetStsCodefeed_lkp"
read by operator "ActvSetStsManFeed_lkp"
Data "ActvSetStsIns_flt:ToHighestKeyAgg.v"(an Orchestrate data set)
written by operator "ActvSetStsIns_flt"
read by operator "ActvSetStsHighestSurKey_agg"
main_program: Could not check all operators because of previous error(s) [api/step_rep.C:1144]
main_program: Creation of a step finished with status = FAILED. [osh.C:1112]
OSH script too lengthy to post
I am using one transformer, 2 look uos , 2 modify stages and 2 filters in my job.
Thank in advance
Ajith
Log looked like this;
main_program: Max inbound connections per node = 1
Max outbound connections per node = 1
main_program: Defining Section Leaders.
main_program: Contacting Section Leaders.
main_program: Broadcasting score.
main_program: Score (9,371 bytes) sent.
main_program: Starting Players.
main_program: Waiting for Players to start.
main_program: Setting up data connections among Players.
main_program: Starting step execution.
main_program: Waiting for step completion.
main_program: Releasing Section Leaders; parallel step time was 0.004 seconds.
main_program: Returning step status of APT_StatusOk.
main_program: Explanation:
Step has 15 operators.
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( CODE_TYPE: string[35]; CODE: string[20]; DESC: string[255]; DATA_SRC_CD: string[2]; ROW_END_DT: string[8]; ) -file /uss/landing/USS300.EXT.Code_Feed.monthly.dat -rejects continue -reportProgress yes
output port 0 bound to data entity "ActvSetStsCodeFeed_seq:ToDataSrcModify.v"
???, invoked with args: -where DATA_SRC_CD =89
input port 0 bound to data entity "ActvSetStsCodeFeed_seq:ToDataSrcModify.v"
output port 0 bound to data entity "ActvSetStsDataSrc_flt:ToCodeFeedLkp.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( ACTV_SET_STS_RSN_STG_KEY: string[8]; ACTV_SET_STS_RSN_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; SRC_ACTV_SET_STS_RSN_CD: string[20]; SRC_ACTV_SET_STS_RSN_DESC: string[255]; DATA_SRC_CD: string[2]; ADD_DT: string[8]; MOD_DT: string[8]; ROW_EFF_DT: string[8]; ROW_END_DT: string[8]; ) -file /uss/unittest/optum/load/UUSS315.LOAD.Code_Stg.ActvRsn.Upd.monthly.load -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToActvSetStsUpdt.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( SRC_CODE: string[20]; SRC_DESC: string[255]; STD_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; DATA_SRC_CD: string[2]; ) -file /uss/landing/MANUAL_ACTIVITY_SET_STATUS_REASON.dat -rejects continue -reportProgress yes
output port 0 bound to data entity "ActvSetStsManFeed_mod:ToManFeedLkp.v"
???, invoked with args: -flag run -name V0S16_USS315StgOpOSAvSetStsRsn_Test_ActvSetStsSrcDescChk_tran
input port 0 bound to data entity "ActvSetStsManFeed_lkp:ToSrcDescChkTrans.v"
output port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToSrcDescReject.v"
output port 1 bound to data entity "ActvSetStsSrcDescChk_tran:ToSurKeyGen.v"
output port 2 bound to data entity "ActvSetStsSrcDescChk_tran:ToActvSetStsUpdt.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( CODE: string[20]; CODE_TYPE: string[35]; DESC: string[255]; DATA_SRC_CD: string[2]; ) -file /uss/unittest/optum/load/USS315.DSINT.Code_Stg.ActvRsn.ERR.monthly.err -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToSrcDescReject.v"
???, invoked with args: -schema record ( ACTV_SET_STS_RSN_STG_KEY: int32 {cycle={init="1+part", incr=partcount}}; )
input port 0 bound to data entity "ActvSetStsSrcDescChk_tran:ToSurKeyGen.v"
output port 0 bound to data entity "ActvSetSts_SurKeyGen:ToHighestKeyCopy.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( ACTV_SET_STS_RSN_STG_KEY: string[8]; ACTV_SET_STS_RSN_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; SRC_ACTV_SET_STS_RSN_CD: string[20]; SRC_ACTV_SET_STS_RSN_DESC: string[255]; DATA_SRC_CD: string[2]; ADD_DT: string[8]; MOD_DT: string[8]; ROW_EFF_DT: string[8]; ROW_END_DT: string[8]; ) -file /uss/unittest/optum/reject/USS315.DSINT.Code_Stg.ActvRsn.SKey.ERR.monthly.err -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsIns_flt:ToSurKeyOverflowReject.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( TABLE_NAME: string[20]; ACTV_SET_STS_RSN_STG_KEY: nullable dfloat; ) -file /uss/unittest/optum/input/USS315.DSINT.Code_Stg.ActvRsn.SKey.monthly.dat -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsHighestSurKey_agg:ToHighestSurKey.v"
???, invoked with args: -schema record {record_delim="\n", record_length=fixed, delim=none} ( ACTV_SET_STS_RSN_STG_KEY: string[8]; ACTV_SET_STS_RSN_DESC: string[255]; ACTV_SET_STS_RSN_CTGY_DESC: string[255]; SRC_ACTV_SET_STS_RSN_CD: string[20]; SRC_ACTV_SET_STS_RSN_DESC: string[255]; DATA_SRC_CD: string[2]; ADD_DT: string[8]; MOD_DT: string[8]; ROW_EFF_DT: string[8]; ROW_END_DT: string[8]; ) -file //uss/unittest/optum/load/USS315.LOAD.Code_Stg.ActvRsn.Ins.monthly.load -overwrite -rejects continue
input port 0 bound to data entity "ActvSetStsIns_flt:ToActvSetStsInsert.v"
???, invoked with args: -table -key CODE -ifNotFound continue
input port 0 bound to data entity "ActvSetStsDataSrc_flt:ToCodeFeedLkp.v"
input port 1 bound to data entity "ActvSetStsStagingTable_mod:ToCodFeedLkp.v"
output port 0 bound to data entity "ActvSetStsCodefeed_lkp:ToManualFeedLkp.v"
???, invoked with args: -table -key CODE -key DESC -keep -key DATA_SRC_CD -ifNotFound continue
input port 0 bound to data entity "ActvSetStsCodefeed_lkp:ToManualFeedLkp.v"
input port 1 bound to data entity "ActvSetStsManFeed_mod:ToManFeedLkp.v"
output port 0 bound to data entity "ActvSetStsManFeed_lkp:ToSrcDescChkTrans.v"
???, invoked with args: -where ACTV_SET_STS_RSN_STG_KEY<100000000 -target 1 -where ACTV_SET_STS_RSN_STG_KEY>99999999 -target 0 -where ACTV_SET_STS_RSN_STG_KEY<100000000 -target 2
input port 0 bound to data entity "ActvSetSts_SurKeyGen:ToHighestKeyCopy.v"
output port 0 bound to data entity "ActvSetStsIns_flt:ToSurKeyOverflowReject.v"
output port 1 bound to data entity "ActvSetStsIns_flt:ToActvSetStsInsert.v"
output port 2 bound to data entity "ActvSetStsIns_flt:ToHighestKeyAgg.v"
???, invoked with args: -hash -key TABLE_NAME -reduce ACTV_SET_STS_RSN_STG_KEY -max ACTV_SET_STS_RSN_STG_KEY
input port 0 bound to data entity "ActvSetStsIns_flt:ToHighestKeyAgg.v"
output port 0 bound to data entity "ActvSetStsHighestSurKey_agg:ToHighestSurKey.v"
???, invoked with args: -schema record {record_delim="\n", delim=","} ( ACTV_SET_STS_RSN_STG_KEY: int32; SRC_ACTV_SET_STS_RSN_CD: string[max=20]; SRC_ACTV_SET_STS_RSN_DESC: string[max=255]; ACTV_SET_STS_RSN_DESC: string[max=255]; ACTV_SET_STS_RSN_CTGY_DESC: string[max=255]; DATA_SRC_CD: int32; ROW_END_DT: string[8]; MOD_DT: string[8]; ) -file /uss/unittest/optum/input/ACTV_SET_STS_STG_RSN.dat -rejects continue -reportProgress yes
output port 0 bound to data entity "ActvSetStsStagingTable_mod:ToCodFeedLkp.v"
Step has 14 data entities.
Data "ActvSetStsCodeFeed_seq:ToDataSrcModify.v"(an Orchestrate data set)
written by operator "ActvSetStsCodeFeed_seq"
read by operator "ActvSetStsDataSrc_flt"
Data "ActvSetStsDataSrc_flt:ToCodeFeedLkp.v"(an Orchestrate data set)
written by operator "ActvSetStsDataSrc_flt"
read by operator "ActvSetStsCodefeed_lkp"
Data "ActvSetStsSrcDescChk_tran:ToActvSetStsUpdt.v"(an Orchestrate data set)
written by operator "ActvSetStsSrcDescChk_tran"
read by operator "ActvSetStsUpd_seq"
Data "ActvSetStsManFeed_lkp:ToSrcDescChkTrans.v"(an Orchestrate data set)
written by operator "ActvSetStsManFeed_lkp"
read by operator "ActvSetStsSrcDescChk_tran"
Data "ActvSetStsSrcDescChk_tran:ToSrcDescReject.v"(an Orchestrate data set)
written by operator "ActvSetStsSrcDescChk_tran"
read by operator "ActvSetStsSrcDescRej_seq"
Data "ActvSetStsSrcDescChk_tran:ToSurKeyGen.v"(an Orchestrate data set)
written by operator "ActvSetStsSrcDescChk_tran"
read by operator "ActvSetSts_SurKeyGen"
Data "ActvSetSts_SurKeyGen:ToHighestKeyCopy.v"(an Orchestrate data set)
written by operator "ActvSetSts_SurKeyGen"
read by operator "ActvSetStsIns_flt"
Data "ActvSetStsIns_flt:ToSurKeyOverflowReject.v"(an Orchestrate data set)
written by operator "ActvSetStsIns_flt"
read by operator "ActvSetStsSurKeyOverFlowRej_seq"
Data "ActvSetStsHighestSurKey_agg:ToHighestSurKey.v"(an Orchestrate data set)
written by operator "ActvSetStsHighestSurKey_agg"
read by operator "ActvSetStsHighestSurKey_seq"
Data "ActvSetStsIns_flt:ToActvSetStsInsert.v"(an Orchestrate data set)
written by operator "ActvSetStsIns_flt"
read by operator "ActvSetStsIns_seq"
Data "ActvSetStsManFeed_mod:ToManFeedLkp.v"(an Orchestrate data set)
written by operator "ActvSetStsManFeed_seq"
read by operator "ActvSetStsManFeed_lkp"
Data "ActvSetStsStagingTable_mod:ToCodFeedLkp.v"(an Orchestrate data set)
written by operator "Sequential_File_98"
read by operator "ActvSetStsCodefeed_lkp"
Data "ActvSetStsCodefeed_lkp:ToManualFeedLkp.v"(an Orchestrate data set)
written by operator "ActvSetStsCodefeed_lkp"
read by operator "ActvSetStsManFeed_lkp"
Data "ActvSetStsIns_flt:ToHighestKeyAgg.v"(an Orchestrate data set)
written by operator "ActvSetStsIns_flt"
read by operator "ActvSetStsHighestSurKey_agg"
main_program: Could not check all operators because of previous error(s) [api/step_rep.C:1144]
main_program: Creation of a step finished with status = FAILED. [osh.C:1112]
OSH script too lengthy to post
I am using one transformer, 2 look uos , 2 modify stages and 2 filters in my job.
Thank in advance
Ajith
Solution
Three of my jobs had the same problem.
When I validate the job I get errors like this
VendAcptStsRsnHighestSurKey_agg: Error when checking operator: Could not find input field "VEND_ACPT_STS_RSN_STG_KEY".
It is there, but datastage is not seeing it, may be that stage got corrupted or something. I leave it for the gurus to contemplate on.
in two jobs I got lookup corrupted, In one a aggregator
Solution : replaced the stages with links involved. That did work!
When I validate the job I get errors like this
VendAcptStsRsnHighestSurKey_agg: Error when checking operator: Could not find input field "VEND_ACPT_STS_RSN_STG_KEY".
It is there, but datastage is not seeing it, may be that stage got corrupted or something. I leave it for the gurus to contemplate on.
in two jobs I got lookup corrupted, In one a aggregator
Solution : replaced the stages with links involved. That did work!
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Ray,
It was not giving any score when it was aborting. The problem was due to an incorrect column name in modify stage. When I corrected it it was okay.
I got the score after running it, but I have no idea how to analyze it. It looks like it,
main_program: This step has no datasets.
It has 1 operator:
op0[1p] {(sequential APT_CombinedOperatorController:
(APT_LicenseCountOp in APT_LicenseOperator)
(APT_LicenseCheckOp in APT_LicenseOperator)
) on nodes (
sps111[op0,p0]
)}
It runs 1 process on 1 node.
main_program: This step has 17 datasets:
ds0: {op0[1p] (sequential First_seq)
eAny<>eCollectAny
op1[2p] (parallel DataSrc_flt)}
ds1: {op1[2p] (parallel DataSrc_flt)
eAny=>eCollectAny
op5[2p] (parallel buffer(0))}
ds2: {op2[1p] (sequential ManFeed_seq)
eEntire->eCollectAny
op6[1p] (parallel APT_LUTCreateOp in ManFeed_lkp)}
ds3: {op3[1p] (sequential Sequential_File_98)
eEntire->eCollectAny
op4[1p] (parallel APT_LUTCreateOp in First_lkp)}
ds4: {op4[1p] (parallel APT_LUTCreateOp in First_lkp)
eEntire<>eCollectAny
op7[2p] (parallel APT_LUTProcessOp in First_lkp)}
ds5: {op4[1p] (parallel APT_LUTCreateOp in First_lkp)
eAny<>eCollectAny
op7[2p] (parallel APT_LUTProcessOp in First_lkp)}
ds6: {op5[2p] (parallel buffer(0))
eSame=>eCollectAny
op7[2p] (parallel APT_LUTProcessOp in First_lkp)}
ds7: {op6[1p] (parallel APT_LUTCreateOp in ManFeed_lkp)
eEntire<>eCollectAny
op9[2p] (parallel APT_CombinedOperatorController:APT_LUTProcessOp in ManFeed_lkp)}
ds8: {op6[1p] (parallel APT_LUTCreateOp in ManFeed_lkp)
eAny<>eCollectAny
op9[2p] (parallel APT_CombinedOperatorController:APT_LUTProcessOp in ManFeed_lkp)}
ds9: {op7[2p] (parallel APT_LUTProcessOp in First_lkp)
eAny=>eCollectAny
op8[2p] (parallel buffer(1))}
ds10: {op8[2p] (parallel buffer(1))
eSame=>eCollectAny
op9[2p] (parallel APT_CombinedOperatorController:APT_LUTProcessOp in ManFeed_lkp)}
ds11: {op9[2p] (parallel APT_CombinedOperatorController:APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
>>eCollectAny
op10[1p] (sequential APT_RealFileExportOperator in SrcDescRej_seq)}
ds12: {op9[2p] (parallel APT_CombinedOperatorController: Ins_flt)
eOther(APT_HashPartitioner { key={ value=TABLE_NAME }
})#>eCollectAny
op11[2p] (parallel APT_HashedGroup2Operator in HighestSurKey_agg)}
ds13: {op9[2p] (parallel APT_CombinedOperatorController: Ins_flt)
>>eCollectAny
op13[1p] (sequential APT_RealFileExportOperator in Ins_seq)}
ds14: {op9[2p] (parallel APT_CombinedOperatorController: Ins_flt)
>>eCollectAny
op14[1p] (sequential APT_RealFileExportOperator in SurKeyOverFlowRej_seq)}
ds15: {op9[2p] (parallel APT_CombinedOperatorController:APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
>>eCollectAny
op15[1p] (sequential APT_RealFileExportOperator in Upd_seq)}
ds16: {op11[2p] (parallel APT_HashedGroup2Operator in HighestSurKey_agg)
[pp] >>eCollectAny
op12[1p] (sequential APT_RealFileExportOperator in HighestSurKey_seq)}
It has 16 operators:
op0[1p] {(sequential First_seq)
on nodes (
sps111[op0,p0]
)}
op1[2p] {(parallel DataSrc_flt)
on nodes (
sps111[op1,p0]
sps111B[op1,p1]
)}
op2[1p] {(sequential ManFeed_seq)
on nodes (
sps111[op2,p0]
)}
op3[1p] {(sequential Sequential_File_98)
on nodes (
sps111[op3,p0]
)}
op4[1p] {(parallel APT_LUTCreateOp in First_lkp)
on nodes (
sps111[op4,p0]
)}
op5[2p] {(parallel buffer(0))
on nodes (
sps111[op5,p0]
sps111B[op5,p1]
)}
op6[1p] {(parallel APT_LUTCreateOp in ManFeed_lkp)
on nodes (
sps111[op6,p0]
)}
op7[2p] {(parallel APT_LUTProcessOp in First_lkp)
on nodes (
sps111[op7,p0]
sps111B[op7,p1]
)}
op8[2p] {(parallel buffer(1))
on nodes (
sps111[op8,p0]
sps111B[op8,p1]
)}
op9[2p] {(parallel APT_CombinedOperatorController:
(APT_LUTProcessOp in ManFeed_lkp)
(APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
( _SurKeyGen)
( Ins_flt)
) on nodes (
sps111[op9,p0]
sps111B[op9,p1]
)}
op10[1p] {(sequential APT_RealFileExportOperator in SrcDescRej_seq)
on nodes (
sps111B[op10,p0]
)}
op11[2p] {(parallel APT_HashedGroup2Operator in HighestSurKey_agg)
on nodes (
sps111[op11,p0]
sps111B[op11,p1]
)}
op12[1p] {(sequential APT_RealFileExportOperator in HighestSurKey_seq)
on nodes (
sps111B[op12,p0]
)}
op13[1p] {(sequential APT_RealFileExportOperator in Ins_seq)
on nodes (
sps111B[op13,p0]
)}
op14[1p] {(sequential APT_RealFileExportOperator in SurKeyOverFlowRej_seq)
on nodes (
sps111B[op14,p0]
)}
op15[1p] {(sequential APT_RealFileExportOperator in Upd_seq)
on nodes (
sps111B[op15,p0]
)}
It runs 22 processes on 2 nodes.
It was not giving any score when it was aborting. The problem was due to an incorrect column name in modify stage. When I corrected it it was okay.
I got the score after running it, but I have no idea how to analyze it. It looks like it,
main_program: This step has no datasets.
It has 1 operator:
op0[1p] {(sequential APT_CombinedOperatorController:
(APT_LicenseCountOp in APT_LicenseOperator)
(APT_LicenseCheckOp in APT_LicenseOperator)
) on nodes (
sps111[op0,p0]
)}
It runs 1 process on 1 node.
main_program: This step has 17 datasets:
ds0: {op0[1p] (sequential First_seq)
eAny<>eCollectAny
op1[2p] (parallel DataSrc_flt)}
ds1: {op1[2p] (parallel DataSrc_flt)
eAny=>eCollectAny
op5[2p] (parallel buffer(0))}
ds2: {op2[1p] (sequential ManFeed_seq)
eEntire->eCollectAny
op6[1p] (parallel APT_LUTCreateOp in ManFeed_lkp)}
ds3: {op3[1p] (sequential Sequential_File_98)
eEntire->eCollectAny
op4[1p] (parallel APT_LUTCreateOp in First_lkp)}
ds4: {op4[1p] (parallel APT_LUTCreateOp in First_lkp)
eEntire<>eCollectAny
op7[2p] (parallel APT_LUTProcessOp in First_lkp)}
ds5: {op4[1p] (parallel APT_LUTCreateOp in First_lkp)
eAny<>eCollectAny
op7[2p] (parallel APT_LUTProcessOp in First_lkp)}
ds6: {op5[2p] (parallel buffer(0))
eSame=>eCollectAny
op7[2p] (parallel APT_LUTProcessOp in First_lkp)}
ds7: {op6[1p] (parallel APT_LUTCreateOp in ManFeed_lkp)
eEntire<>eCollectAny
op9[2p] (parallel APT_CombinedOperatorController:APT_LUTProcessOp in ManFeed_lkp)}
ds8: {op6[1p] (parallel APT_LUTCreateOp in ManFeed_lkp)
eAny<>eCollectAny
op9[2p] (parallel APT_CombinedOperatorController:APT_LUTProcessOp in ManFeed_lkp)}
ds9: {op7[2p] (parallel APT_LUTProcessOp in First_lkp)
eAny=>eCollectAny
op8[2p] (parallel buffer(1))}
ds10: {op8[2p] (parallel buffer(1))
eSame=>eCollectAny
op9[2p] (parallel APT_CombinedOperatorController:APT_LUTProcessOp in ManFeed_lkp)}
ds11: {op9[2p] (parallel APT_CombinedOperatorController:APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
>>eCollectAny
op10[1p] (sequential APT_RealFileExportOperator in SrcDescRej_seq)}
ds12: {op9[2p] (parallel APT_CombinedOperatorController: Ins_flt)
eOther(APT_HashPartitioner { key={ value=TABLE_NAME }
})#>eCollectAny
op11[2p] (parallel APT_HashedGroup2Operator in HighestSurKey_agg)}
ds13: {op9[2p] (parallel APT_CombinedOperatorController: Ins_flt)
>>eCollectAny
op13[1p] (sequential APT_RealFileExportOperator in Ins_seq)}
ds14: {op9[2p] (parallel APT_CombinedOperatorController: Ins_flt)
>>eCollectAny
op14[1p] (sequential APT_RealFileExportOperator in SurKeyOverFlowRej_seq)}
ds15: {op9[2p] (parallel APT_CombinedOperatorController:APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
>>eCollectAny
op15[1p] (sequential APT_RealFileExportOperator in Upd_seq)}
ds16: {op11[2p] (parallel APT_HashedGroup2Operator in HighestSurKey_agg)
[pp] >>eCollectAny
op12[1p] (sequential APT_RealFileExportOperator in HighestSurKey_seq)}
It has 16 operators:
op0[1p] {(sequential First_seq)
on nodes (
sps111[op0,p0]
)}
op1[2p] {(parallel DataSrc_flt)
on nodes (
sps111[op1,p0]
sps111B[op1,p1]
)}
op2[1p] {(sequential ManFeed_seq)
on nodes (
sps111[op2,p0]
)}
op3[1p] {(sequential Sequential_File_98)
on nodes (
sps111[op3,p0]
)}
op4[1p] {(parallel APT_LUTCreateOp in First_lkp)
on nodes (
sps111[op4,p0]
)}
op5[2p] {(parallel buffer(0))
on nodes (
sps111[op5,p0]
sps111B[op5,p1]
)}
op6[1p] {(parallel APT_LUTCreateOp in ManFeed_lkp)
on nodes (
sps111[op6,p0]
)}
op7[2p] {(parallel APT_LUTProcessOp in First_lkp)
on nodes (
sps111[op7,p0]
sps111B[op7,p1]
)}
op8[2p] {(parallel buffer(1))
on nodes (
sps111[op8,p0]
sps111B[op8,p1]
)}
op9[2p] {(parallel APT_CombinedOperatorController:
(APT_LUTProcessOp in ManFeed_lkp)
(APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
( _SurKeyGen)
( Ins_flt)
) on nodes (
sps111[op9,p0]
sps111B[op9,p1]
)}
op10[1p] {(sequential APT_RealFileExportOperator in SrcDescRej_seq)
on nodes (
sps111B[op10,p0]
)}
op11[2p] {(parallel APT_HashedGroup2Operator in HighestSurKey_agg)
on nodes (
sps111[op11,p0]
sps111B[op11,p1]
)}
op12[1p] {(sequential APT_RealFileExportOperator in HighestSurKey_seq)
on nodes (
sps111B[op12,p0]
)}
op13[1p] {(sequential APT_RealFileExportOperator in Ins_seq)
on nodes (
sps111B[op13,p0]
)}
op14[1p] {(sequential APT_RealFileExportOperator in SurKeyOverFlowRej_seq)
on nodes (
sps111B[op14,p0]
)}
op15[1p] {(sequential APT_RealFileExportOperator in Upd_seq)
on nodes (
sps111B[op15,p0]
)}
It runs 22 processes on 2 nodes.
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
This piece shows that operators for four stages are being combined into one process:
But, as you say, you seem to have found the problem as an incorrect column in a Modify stage, that you've corrected. Which is curious, given your earlier statement
Set APT_DISABLE_COMBINATION to True to force separate processes for each operator; it will become much easier to diagnose.op9[2p] {(parallel APT_CombinedOperatorController:
(APT_LUTProcessOp in ManFeed_lkp)
(APT_TransformOperatorImplV0S114_Rsn321_Test_Transformer_114 in Transformer_114)
( _SurKeyGen)
( Ins_flt)
) on nodes (
sps111[op9,p0]
sps111B[op9,p1]
)}
But, as you say, you seem to have found the problem as an incorrect column in a Modify stage, that you've corrected. Which is curious, given your earlier statement
Nor can I find a modify operator in the score.I am using one transformer, 2 look uos , 2 modify stages and 2 filters in my job.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Re: Could not check all operators
are you using 'Generated SQL' or 'User Defined'?
Are you using 'alias' names for col.?
Are you using 'alias' names for col.?
ajith wrote:main_program: orchgeneral: loaded
orchsort: loaded
orchstats: loaded
main_program: Returning step status of APT_StatusOk.
main_program: Could not check all operators because of previous error(s) [api/step_rep.C:1144]
(There is no previous error mentioned in the log)
main_program: Creation of a step finished with status = FAILED. [osh.C:1112]
What can be the cause of the problem and how to diagnose it?
Thanks in advance,
Ajith
Thank you,
Anu
Anu