Error while importing EBCDIC characterset ,binaryformat data

srekant · Post by **srekant** » Fri Feb 25, 2005 8:12 am

hi,
we are using Parallel extender 7.5 we are trying to import EBCDIC characterset ,binaryformat data using PX7.5 Complex flat file stage but it is throwing the following error we are able to view data using complex flat file stage in server jobs. can any one help me out .

##I TFCN 000001 10:38:26(000) <main_program>
Ascential DataStage(tm) Enterprise Edition 7.5.0.1
Copyright (c) 2004, 1997-2004 Ascential Software Corporation.
All Rights Reserved

##I TUTL 000031 10:38:26(001) <main_program> The open files limit is 100; raising to 1024.
##I TOSH 000002 10:38:26(002) <main_program> orchgeneral: loaded
##I TOSH 000002 10:38:26(003) <main_program> orchsort: loaded
##I TOSH 000002 10:38:26(004) <main_program> orchstats: loaded
##I TFSC 000001 10:38:27(000) <main_program> APT configuration file: /p1/iar/users/dsadm/Ascential/DataStage/Configurations/default.apt
##W TCOS 000049 10:38:28(000) <main_program> Parameter specified but not used in flow: DSProjectMapName
##W TOIX 000000 10:38:34(000) <Complex_Flat_File_0,0> Field "CONTR_ACQ_DISC" has import error and no default value; data: {00 00 03 df l 14}, at offset: 69
##W TOIX 000154 10:38:34(001) <Complex_Flat_File_0,0> Import warning at record 0:
##W TOIX 000018 10:38:34(002) <Complex_Flat_File_0,0> Import unsuccessful at record 0:
##W TOIX 000000 10:38:34(003) <Complex_Flat_File_0,0> Field "CONTR_VOL_ACT_YR_MONTH" has import error and no default value; data: {0 0 0 0}, at offset: 0
##W TOIX 000154 10:38:34(004) <Complex_Flat_File_0,0> Import warning at record 1:
##W TOIX 000018 10:38:34(005) <Complex_Flat_File_0,0> Import unsuccessful at record 1:
##W TOIX 000000 10:38:34(006) <Complex_Flat_File_0,0> Field "CONTR_VOL_ACT_YR_MONTH" has import error and no default value; data: {0 0 5 6}, at offset: 0
##W TOIX 000154 10:38:34(007) <Complex_Flat_File_0,0> Import warning at record 2:
##W TOIX 000018 10:38:34(008) <Complex_Flat_File_0,0> Import unsuccessful at record 2:
##W TOIX 000000 10:38:34(009) <Complex_Flat_File_0,0> Field "CONTR_VOL_ACT_YR_MONTH" has import error and no default value; data: {0 0 0 0}, at offset: 0
##W TOIX 000154 10:38:34(010) <Complex_Flat_File_0,0> Import warning at record 3:
##W TOIX 000018 10:38:34(011) <Complex_Flat_File_0,0> Import unsuccessful at record 3:
##W TOIX 000000 10:38:34(012) <Complex_Flat_File_0,0> Field "CONTR_VOL_ACT_YR_MONTH" has import error and no default value; data: {0 0 9 0}, at offset: 0
##W TOIX 000154 10:38:34(013) <Complex_Flat_File_0,0> Import warning at record 4:
##W TOIX 000018 10:38:34(014) <Complex_Flat_File_0,0> Import unsuccessful at record 4:
##I TOIX 000157 10:38:34(015) <Complex_Flat_File_0,0> (no further reports will be generated from this partition until successful import)
##I TOIX 000156 10:38:34(016) <Complex_Flat_File_0,0> Progress: 10 percent
##I TOIX 000156 10:38:34(017) <Complex_Flat_File_0,0> Progress: 20 percent
##I TOIX 000156 10:38:34(018) <Complex_Flat_File_0,0> Progress: 30 percent
##I TOIX 000156 10:38:35(000) <Complex_Flat_File_0,0> Progress: 40 percent
##I TOIX 000156 10:38:35(001) <Complex_Flat_File_0,0> Progress: 50 percent
##I TOIX 000156 10:38:35(002) <Complex_Flat_File_0,0> Progress: 60 percent
##I TOIX 000156 10:38:35(003) <Complex_Flat_File_0,0> Progress: 70 percent
##I TOIX 000156 10:38:35(004) <Complex_Flat_File_0,0> Progress: 80 percent
##I TOIX 000156 10:38:35(005) <Complex_Flat_File_0,0> Progress: 90 percent
>##E TOIX 000159 10:38:35(006) <Complex_Flat_File_0,0> Short read encountered on import. This most likely indicates one of the following possibilities:
>1) The import schema you specified is incorrect
>2) Invalid data (the schema is correct, but there is an error in the data)
##I TOIX 000094 10:38:35(007) <Complex_Flat_File_0,0> Output 0 produced 0 records
>##E TOIX 000043 10:38:35(008) <Complex_Flat_File_0,0> Expected 722 record bytes, got 153
>##E TOIX 000179 10:38:35(009) <Complex_Flat_File_0,0> Import error at record 4128.
>##E TOIX 000089 10:38:35(010) <Complex_Flat_File_0,0> Operator's runLocally() failed
>##E TFCI 000089 10:38:35(011) <APT_CombinedOperatorController,0> Operator's runLocally() failed
>##E TFPM 000040 10:38:35(012) <APT_CombinedOperatorController,0> Operator terminated abnormally: runLocally did not return APT_StatusOk
>##E TFSR 000011 10:38:41(000) <main_program> Step execution finished with status = FAILED.
##I TCOS 000026 10:38:41(001) <main_program> Startup Time 0:12 Production Run Time 0:02

thanks
cheers
sree

Code: Select all

ArndW · Post by **ArndW** » Fri Feb 25, 2005 8:34 am

srekant,

if you go into your designer and try a right-mouse-click view-data on the CFF input stage, what errors do you see? This might be easier and faster than recompiling and running the job.

Start with your first error, what is your COBOL data type for the field CONTR_ACQ_DISC and is it the first coumn in your definition?

srekant · Post by **srekant** » Fri Feb 25, 2005 8:53 am

CONTR_ACQ_DISC is not the first column CONTR_VOL_ACT_YR_MONTH is the fist column and datatype is of decimal

ArndW · Post by **ArndW** » Fri Feb 25, 2005 9:18 am

What happens when you do a Designer view-data? It looks like the format is getting mixed up at CONTR_ACQ_DISC on the first row, and then the beginning of the second row, column CONTR_VOL_ACT_YR_MONTH is also getting read incorrectly, most likely the file has not terminators and therefore a bad length will cause every subsequent column & row to be read incorrectly.

What is the decimal PIC and what does DS show for it's definition? What is the value of that field in the file (use some editor that shows binary information)?