Standardization job along with WISD IP/OP
Posted: Mon Jul 06, 2009 10:25 am
I built a job for address standardization. The job looks like:
Seq File->Standardize(Country.set)->Filter->Standardize(MXADDR.set)->Seq File
Now in place of the input and output Sequential files, I attached WISD Input and WISD output Stages respectively.
The job with the above configuration is not giving an output. As per the error log, the job is aborted after 3 hrs.
5:43:38 PM
main_program: This step has 5 datasets:
ds0: {op0[1p] (sequential MDM_Input_Address)
eAny->eCollectAny
op1[1p] (parallel StandardizeCNTRY)}
ds1: {op1[1p] (parallel StandardizeCNTRY)
eAny->eCollectAny
op2[1p] (parallel APT_CombinedOperatorController:SelectMX)}
ds2: {op2[1p] (parallel APT_CombinedOperatorController:APT_TransformOperatorImplV18S3_ISD_MDMQS_Address_Standardization4_Transformer_59 in Transformer_59)
eAny->eCollectAny
op3[1p] (parallel StandardizeAddr)}
ds3: {op3[1p] (parallel StandardizeAddr)
eAny->eCollectAny
op4[1p] (parallel APT_TransformOperatorImplV18S4_ISD_MDMQS_Address_Standardization4_Transformer_73 in Transformer_73)}
ds4: {op4[1p] (parallel APT_TransformOperatorImplV18S4_ISD_MDMQS_Address_Standardization4_Transformer_73 in Transformer_73)
->eCollectAny
op5[1p] (sequential QS_Output_Address)}
It has 6 operators:
op0[1p] {(sequential MDM_Input_Address)
on nodes (
node1[op0,p0]
)}
op1[1p] {(parallel StandardizeCNTRY)
on nodes (
node1[op1,p0]
)}
op2[1p] {(parallel APT_CombinedOperatorController:
(SelectMX)
(APT_TransformOperatorImplV18S3_ISD_MDMQS_Address_Standardization4_Transformer_59 in Transformer_59)
) on nodes (
node1[op2,p0]
)}
op3[1p] {(parallel StandardizeAddr)
on nodes (
node1[op3,p0]
)}
op4[1p] {(parallel APT_TransformOperatorImplV18S4_ISD_MDMQS_Address_Standardization4_Transformer_73 in Transformer_73)
on nodes (
node1[op4,p0]
)}
op5[1p] {(sequential QS_Output_Address)
on nodes (
node1[op5,p0]
)}
It runs 6 processes on 1 node.
9:09:06 PM
Job control process (pid 1188020) has failed
I have tried this a couple of times. However I see that the default job which comes with IIS:
a). which does the act of Address Standardization for MDM, using Standardization Rules MDMUSA
b). and which also if feeded in the form of a container between the WISD input and WISD output stages
works fine.
Am I missing some configuration?
Note:
1. Having a doubt that the rulesets I am using(COUNTRY.set and MXADDR.set) should be there in the same sub-project where the job is there, I re-imported the rulesets at the appropriate location.
Seq File->Standardize(Country.set)->Filter->Standardize(MXADDR.set)->Seq File
Now in place of the input and output Sequential files, I attached WISD Input and WISD output Stages respectively.
The job with the above configuration is not giving an output. As per the error log, the job is aborted after 3 hrs.
5:43:38 PM
main_program: This step has 5 datasets:
ds0: {op0[1p] (sequential MDM_Input_Address)
eAny->eCollectAny
op1[1p] (parallel StandardizeCNTRY)}
ds1: {op1[1p] (parallel StandardizeCNTRY)
eAny->eCollectAny
op2[1p] (parallel APT_CombinedOperatorController:SelectMX)}
ds2: {op2[1p] (parallel APT_CombinedOperatorController:APT_TransformOperatorImplV18S3_ISD_MDMQS_Address_Standardization4_Transformer_59 in Transformer_59)
eAny->eCollectAny
op3[1p] (parallel StandardizeAddr)}
ds3: {op3[1p] (parallel StandardizeAddr)
eAny->eCollectAny
op4[1p] (parallel APT_TransformOperatorImplV18S4_ISD_MDMQS_Address_Standardization4_Transformer_73 in Transformer_73)}
ds4: {op4[1p] (parallel APT_TransformOperatorImplV18S4_ISD_MDMQS_Address_Standardization4_Transformer_73 in Transformer_73)
->eCollectAny
op5[1p] (sequential QS_Output_Address)}
It has 6 operators:
op0[1p] {(sequential MDM_Input_Address)
on nodes (
node1[op0,p0]
)}
op1[1p] {(parallel StandardizeCNTRY)
on nodes (
node1[op1,p0]
)}
op2[1p] {(parallel APT_CombinedOperatorController:
(SelectMX)
(APT_TransformOperatorImplV18S3_ISD_MDMQS_Address_Standardization4_Transformer_59 in Transformer_59)
) on nodes (
node1[op2,p0]
)}
op3[1p] {(parallel StandardizeAddr)
on nodes (
node1[op3,p0]
)}
op4[1p] {(parallel APT_TransformOperatorImplV18S4_ISD_MDMQS_Address_Standardization4_Transformer_73 in Transformer_73)
on nodes (
node1[op4,p0]
)}
op5[1p] {(sequential QS_Output_Address)
on nodes (
node1[op5,p0]
)}
It runs 6 processes on 1 node.
9:09:06 PM
Job control process (pid 1188020) has failed
I have tried this a couple of times. However I see that the default job which comes with IIS:
a). which does the act of Address Standardization for MDM, using Standardization Rules MDMUSA
b). and which also if feeded in the form of a container between the WISD input and WISD output stages
works fine.
Am I missing some configuration?
Note:
1. Having a doubt that the rulesets I am using(COUNTRY.set and MXADDR.set) should be there in the same sub-project where the job is there, I re-imported the rulesets at the appropriate location.