Job failed

nagarjuna · Post by **nagarjuna** » Fri May 15, 2009 8:56 am

Hi ,

I have a job which is getting aborted .Please check the log below for more details .

DataStage Report - Summary Log for job: Jobname.instancename
Produced on: 5/15/2009 9:07:07 AM
Project: projectname Host system: hostname
Items: 1 - 100
Sorted on: Date Sorter

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "MAX_BTCH_CNTL_ID" to field "MAX_BTCH_CNTL_ID": Implicit conversion from source type "decimal[38,10 (...)

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "MAX_BTCH_CNTL_ID" to field "MAX_BTCH_CNTL_ID": Converting a nullable source to a non-nullable resu (...)

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "dummy" to field "dummy": Implicit conversion from source type "decimal[38,10]" to result type "int (...)

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "dummy" to field "dummy": Converting a nullable source to a non-nullable result; (...)

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: SharedContainer.ORC_SOURCE_SYSTEM_MASTER: When checking operator: When binding output interface field "SRC_SYS_CD" to field "SRC_SYS_CD": Implicit conversion from source type "string[max=30]" (...)

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: LKP_BATCH_DTL_ID: When checking operator: Operator of type "APT_LUTCreateOp": will partition despite the (...)

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "col_str" in transfer from "inRec" to "outRec".

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "ETL_str" in transfer from "inRec" to "outRec".

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "Dumy" in transfer from "inRec" to "outRec".

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "SRC_SYS_CD" in transfer from "inRec" to "outRec".

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "EXTR_BTCH_DTL_ID" in transfer from "inRec" to "outRec".

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "SRC_SYS_ID" in transfer from "inRec" to "outRec".

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: CI_IMPORT_COL: When checking operator: Dropping component "EXTR_BTCH_DTL_ID" because of a prior component with the same name.

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: CI_IMPORT_COL: When checking operator: Dropping component "SRC_SYS_ID" because of a prior component with the same name.

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field col_str was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field ETL_str was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 2:12:41 PM On date: 5/14/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field Dumy was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field SRC_SYS_CD was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: SEQF_REJECTS,0: Import complete; 0 records imported successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_FOR_REJ,0: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_FOR_REJ,1: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_FOR_REJ,2: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_FOR_REJ,3: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: SEQ_SRC_FILE_E2,0: Import complete; 0 records imported successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E2,0: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E2,2: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E2,1: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E2,3: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: SEQ_SRC_FILE_E1,0: Import complete; 0 records imported successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E1,0: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E1,1: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:42 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E1,2: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: CE_MK_COLMN_E1,3: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: SharedContainer.ORC_BATCH_EXTRACT_DETAIL,0: Records inserted: 0 (...)

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: SharedContainer.ORC_BATCH_EXTRACT_DETAIL,1: Records inserted: 0 (...)

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: SharedContainer.ORC_BATCH_EXTRACT_DETAIL,2: Records inserted: 0 (...)

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: SharedContainer.ORC_BATCH_EXTRACT_DETAIL,3: Records inserted: 0 (...)

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: CI_IMPORT_COL,1: Field import complete; 0 records converted successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: CI_IMPORT_COL,0: Field import complete; 0 records converted successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: CI_IMPORT_COL,2: Field import complete; 0 records converted successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: CI_IMPORT_COL,3: Field import complete; 0 records converted successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: ORC_TARGET_OBJECTNAME,0: Export complete; 0 records exported successfully, 0 rejected.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: ORC_TARGET_OBJECTNAME,0: Load completed - logical record count 0.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: main_program: Step execution finished with status = OK.

Occurred: 2:12:44 PM On date: 5/14/2009 Type: Info
Event: main_program: Startup time, 0:06; production run time, 0:02.

Occurred: 2:12:50 PM On date: 5/14/2009 Type: Info
Event: Parallel job reports successful completion

Occurred: 2:12:52 PM On date: 5/14/2009 Type: Control
Event: Finished Job Jobname.instancename.

Occurred: 2:12:52 PM On date: 5/14/2009 Type: RunJob
Event: (Sequence_Name) <- Jobname.instancename: Job under control finished.

Occurred: 8:39:45 AM On date: 5/15/2009 Type: Control
Event: Starting Job Jobname.instancename. (...)

Occurred: 8:39:50 AM On date: 5/15/2009 Type: Info
Event: Environment variable settings: (...)

Occurred: 8:39:50 AM On date: 5/15/2009 Type: Info
Event: Parallel job initiated

Occurred: 8:39:50 AM On date: 5/15/2009 Type: Info
Event: OSH script (...)

Occurred: 8:39:51 AM On date: 5/15/2009 Type: Info
Event: main_program: IBM WebSphere DataStage Enterprise Edition 8.0.1.4994 (...)

Occurred: 8:39:51 AM On date: 5/15/2009 Type: Info
Event: main_program: The open files limit is 2048; raising to 2147483647.

Occurred: 8:39:51 AM On date: 5/15/2009 Type: Info
Event: main_program: orchgeneral: loaded (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Info
Event: main_program: APT configuration file: /opt/IBM/InformationServer/Server/Configurations/config4x4_DSS20_initload.apt (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "MAX_BTCH_CNTL_ID" to field "MAX_BTCH_CNTL_ID": Implicit conversion from source type "decimal[38,10 (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "MAX_BTCH_CNTL_ID" to field "MAX_BTCH_CNTL_ID": Converting a nullable source to a non-nullable resu (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "dummy" to field "dummy": Implicit conversion from source type "decimal[38,10]" to result type "int (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: SharedContainer.ORC_BATCH_AUDIT: When checking operator: When binding output interface field "dummy" to field "dummy": Converting a nullable source to a non-nullable result; (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: SharedContainer.ORC_SOURCE_SYSTEM_MASTER: When checking operator: When binding output interface field "SRC_SYS_CD" to field "SRC_SYS_CD": Implicit conversion from source type "string[max=30]" (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: LKP_BATCH_DTL_ID: When checking operator: Operator of type "APT_LUTCreateOp": will partition despite the (...)

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "col_str" in transfer from "inRec" to "outRec".

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "ETL_str" in transfer from "inRec" to "outRec".

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "Dumy" in transfer from "inRec" to "outRec".

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "SRC_SYS_CD" in transfer from "inRec" to "outRec".

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "EXTR_BTCH_DTL_ID" in transfer from "inRec" to "outRec".

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: MERGE_CURR_EXTRACTS_REJECTS: When checking operator: Defaulting "SRC_SYS_ID" in transfer from "inRec" to "outRec".

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: CI_IMPORT_COL: When checking operator: Dropping component "EXTR_BTCH_DTL_ID" because of a prior component with the same name.

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: CI_IMPORT_COL: When checking operator: Dropping component "SRC_SYS_ID" because of a prior component with the same name.

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field col_str was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field ETL_str was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 8:39:55 AM On date: 5/15/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field Dumy was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Warning
Event: ORC_TARGET_OBJECTNAME: When checking operator: Input field SRC_SYS_CD was dropped because it does not exist in table pbmdss_stage_owner.enrollment_update_cd.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_FOR_REJ,3: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: SEQF_REJECTS,0: Import complete; 0 records imported successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_FOR_REJ,0: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_FOR_REJ,2: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_FOR_REJ,1: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Fatal
Event: SEQ_SRC_FILE_E1,0: Filter status 512; (...)

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Warning
Event: SEQ_SRC_FILE_E1,0: Source subproc: cat: cannot open /usr/local/verify/dss/inputfiles/acmrs_P1*.txt (...)

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Fatal
Event: SEQ_SRC_FILE_E1,0: Import error at record 0.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Fatal
Event: SEQ_SRC_FILE_E1,0: The runLocally() of the operator failed.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: SEQ_SRC_FILE_E1,0: Output 0 produced 0 records.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: SEQ_SRC_FILE_E2,0: Import complete; 0 records imported successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_COLMN_E2,0: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_COLMN_E2,1: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_COLMN_E2,2: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Info
Event: CE_MK_COLMN_E2,3: Field export complete. 0 records converted successfully, 0 rejected.

Occurred: 8:39:57 AM On date: 5/15/2009 Type: Fatal
Event: SEQ_SRC_FILE_E1,0: Operator terminated abnormally: runLocally did not return APT_StatusOk

Occurred: 8:40:02 AM On date: 5/15/2009 Type: Fatal
Event: main_program: APT_PMsectionLeader(4, node4), player 4 - Unexpected exit status 1. (...)

Occurred: 8:40:02 AM On date: 5/15/2009 Type: Fatal
Event: main_program: Step execution finished with status = FAILED.

Occurred: 8:40:02 AM On date: 5/15/2009 Type: Info
Event: main_program: Startup time, 0:10; production run time, 0:01.

Occurred: 8:40:03 AM On date: 5/15/2009 Type: Control
Event: Job Jobname.instancename aborted.

Occurred: 8:40:03 AM On date: 5/15/2009 Type: RunJob
Event: (Sequence_Name) <- Jobname.instancename: Job under control finished.

Occurred: 9:07:28 AM On date: 5/15/2009 Type: Control
Event: Resetting Job Jobname.instancename.

Occurred: 9:07:28 AM On date: 5/15/2009 Type: Control
Event: Job Jobname.instancename has been reset.

Occurred: 9:07:28 AM On date: 5/15/2009 Type: RunJob
Event: (Sequence_Name) <- Jobname.instancename: Job under control finished.

Occurred: 9:07:29 AM On date: 5/15/2009 Type: Info
Event: From previous run (...)

Occurred: 9:07:30 AM On date: 5/15/2009 Type: Control
Event: Starting Job Jobname.instancename. (...)

End of report.

Please let me know if you require more information on it .

Thanks in advance .

throbinson · Post by **throbinson** » Fri May 15, 2009 9:08 am

I believe that is enough detail. As a general comment, You've got tons of Metadata problems. You've got to match your Oracle Stage with the actual DDL in Oracle, including Nullability. One gotcha is function calls; They are reported to DataStage as DECIMAL(38,10). Another is an Oracle NUMBER no precision, scale field. They also come through as DECIMAL(38,10). You need to reconcile them in the Column definitions and then change them to whatever you want them to be firther along in the failing job.

nagarjuna · Post by **nagarjuna** » Fri May 15, 2009 9:18 am

Thanks throbinson for your suggestion . I do agree that in our job we have some metadata problems .But , Is it the reason why this job failed ?

throbinson · Post by **throbinson** » Fri May 15, 2009 9:27 am

Probably this;

Occurred: 8:39:56 AM On date: 5/15/2009 Type: Fatal
Event: SEQ_SRC_FILE_E1,0: Filter status 512; (...)

But so what? Whenever I get a gazillion warnings, I start at the first one and fix as many as I can before re-running. Some of the more obvious ones might be cascading into others which may be leading to the proximate FATAL that stopped the job. You might get lucky with cherry picking faults but I prefer a more structured approach to Troubleshooting.