Page 1 of 1

Complex flat file (CFF) reading issue

Posted: Tue Sep 15, 2015 1:45 pm
by ureddy
Hi All,

Iam trying to read a Cobol File whch has 19 multiple subsegments plus Header and trailer. All these subsegments have different lengh and I have 19 cobol copy books to read the file. I am reading the file based on Record type. I have given all the 19 cobol copy books along with the Header and trailer copy books in CFF stage.
When I tried to read the View data I can able to see Header and Trailer data but not each subsegment data. When I tried to see the data for each 19 subsegments the below error is coming. Can any one please help me to understand this issue.



##I IIS-DSEE-TFCN-00001 12:43:34(000) <main_program>
IBM WebSphere DataStage Enterprise Edition 8.5.0.5946
Copyright (c) 2001, 2005-2008 IBM Corporation. All rights reserved


##I IIS-DSEE-TFCN-00006 12:43:34(001) <main_program> conductor uname: -s=AIX; -r=1; -v=6; -n=ldwgtdb1d; -m=00F657EE4C00
##I IIS-DSEE-TOSH-00002 12:43:34(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 12:43:34(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 12:43:34(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 12:43:34(005) <main_program> Parameter specified but not used in flow: _APT_CONFIG_FILE
##W IIS-DSEE-TOSH-00049 12:43:34(006) <main_program> Parameter specified but not used in flow: DSProjectMapName
##I IIS-DSEE-TFSC-00001 12:43:39(004) <main_program> APT configuration file: /opt/IBM/InformationServer/Server/Configurations/Regional_Projects.apt
##I IIS-DSEE-TOIX-00163 12:44:39(000) <Complex_Flat_File_350,0> Import complete; 120368 records imported successfully, 0 rejected.
**VIEWDATA ROW LIMITER HIT**
>##E IIS-DSEE-TFOR-00089 12:44:39(001) <_ABORT_IDENT_,0> The runLocally() of the operator failed.
##I IIS-DSEE-TFOR-00163 12:44:39(002) <_ABORT_IDENT_,0> Input 0 consumed 0 records.
##I IIS-DSEE-USBP-00001 12:44:39(000) <APT_CombinedOperatorController,0> called postFinalRunLocally
>##E IIS-DSEE-TFOR-00089 12:44:39(003) <APT_CombinedOperatorController,0> The runLocally() of the operator failed.
>##E IIS-DSEE-TFPM-00040 12:44:39(004) <APT_CombinedOperatorController,0> Operator terminated abnormally: runLocally() did not return APT_StatusOk
>##E IIS-DSEE-TFPM-00192 12:44:46(000) <node_node1> Player 1 terminated unexpectedly.
>##E IIS-DSEE-TFSC-00011 12:44:51(000) <main_program> Step execution finished with status = FAILED.
##I IIS-DSEE-TCOS-00026 12:44:51(001) <main_program> Startup time, 0:11; production run time, 1:05.

Re: Complex flat file (CFF) reading issue

Posted: Tue Sep 15, 2015 2:04 pm
by ureddy
Hi,


I tried keeping the ROW LIMIT in CFF stage to 1 but still Could to able to read the file except header and trailer record .
My record schema is below.
{record_format={type=implicit}, delim=none, quote=none, binary, ebcdic, native_endian, charset='ASCL_ISO8859-1', round=round_inf, nofix_zero}

Posted: Tue Sep 15, 2015 4:16 pm
by chulett
I don't know what's going on but it's not related to the ROW LIMIT being hit, that's just a normal Informational message.

Posted: Tue Sep 15, 2015 4:24 pm
by ray.wurlod
Start by disabling operator combination, so you can ascertain precisely which stage is throwing the error.