Complex flat file (CFF) reading issue

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ureddy
Premium Member
Premium Member
Posts: 36
Joined: Wed May 14, 2008 1:59 pm

Complex flat file (CFF) reading issue

Post by ureddy »

Hi All,

Iam trying to read a Cobol File whch has 19 multiple subsegments plus Header and trailer. All these subsegments have different lengh and I have 19 cobol copy books to read the file. I am reading the file based on Record type. I have given all the 19 cobol copy books along with the Header and trailer copy books in CFF stage.
When I tried to read the View data I can able to see Header and Trailer data but not each subsegment data. When I tried to see the data for each 19 subsegments the below error is coming. Can any one please help me to understand this issue.



##I IIS-DSEE-TFCN-00001 12:43:34(000) <main_program>
IBM WebSphere DataStage Enterprise Edition 8.5.0.5946
Copyright (c) 2001, 2005-2008 IBM Corporation. All rights reserved


##I IIS-DSEE-TFCN-00006 12:43:34(001) <main_program> conductor uname: -s=AIX; -r=1; -v=6; -n=ldwgtdb1d; -m=00F657EE4C00
##I IIS-DSEE-TOSH-00002 12:43:34(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 12:43:34(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 12:43:34(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 12:43:34(005) <main_program> Parameter specified but not used in flow: _APT_CONFIG_FILE
##W IIS-DSEE-TOSH-00049 12:43:34(006) <main_program> Parameter specified but not used in flow: DSProjectMapName
##I IIS-DSEE-TFSC-00001 12:43:39(004) <main_program> APT configuration file: /opt/IBM/InformationServer/Server/Configurations/Regional_Projects.apt
##I IIS-DSEE-TOIX-00163 12:44:39(000) <Complex_Flat_File_350,0> Import complete; 120368 records imported successfully, 0 rejected.
**VIEWDATA ROW LIMITER HIT**
>##E IIS-DSEE-TFOR-00089 12:44:39(001) <_ABORT_IDENT_,0> The runLocally() of the operator failed.
##I IIS-DSEE-TFOR-00163 12:44:39(002) <_ABORT_IDENT_,0> Input 0 consumed 0 records.
##I IIS-DSEE-USBP-00001 12:44:39(000) <APT_CombinedOperatorController,0> called postFinalRunLocally
>##E IIS-DSEE-TFOR-00089 12:44:39(003) <APT_CombinedOperatorController,0> The runLocally() of the operator failed.
>##E IIS-DSEE-TFPM-00040 12:44:39(004) <APT_CombinedOperatorController,0> Operator terminated abnormally: runLocally() did not return APT_StatusOk
>##E IIS-DSEE-TFPM-00192 12:44:46(000) <node_node1> Player 1 terminated unexpectedly.
>##E IIS-DSEE-TFSC-00011 12:44:51(000) <main_program> Step execution finished with status = FAILED.
##I IIS-DSEE-TCOS-00026 12:44:51(001) <main_program> Startup time, 0:11; production run time, 1:05.
Reddy
ureddy
Premium Member
Premium Member
Posts: 36
Joined: Wed May 14, 2008 1:59 pm

Re: Complex flat file (CFF) reading issue

Post by ureddy »

Hi,


I tried keeping the ROW LIMIT in CFF stage to 1 but still Could to able to read the file except header and trailer record .
My record schema is below.
{record_format={type=implicit}, delim=none, quote=none, binary, ebcdic, native_endian, charset='ASCL_ISO8859-1', round=round_inf, nofix_zero}
Reddy
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I don't know what's going on but it's not related to the ROW LIMIT being hit, that's just a normal Informational message.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Start by disabling operator combination, so you can ascertain precisely which stage is throwing the error.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply