Hi All,
We are trying to decode a dataset but not able to do the same.
Step 1:
We first converted a sequential file to dataset which is encoded using encode stage in parallel job.
Command line used : gzip
Seq file has 2 columns a,b
Schema definition for dataset :
record
( t: tagged {preservePartitioning=no}
( encoded: subrec
( bufferNumber: dfloat;
bufferLength: int32;
bufferData: raw[32000];
);
schema: subrec
( a: nullable string[max=10];
b: nullable string[max=10];
);
noPreservePartitioning: int32;
);
)
Step 2:
While we try to decode the dataset(created in step 1) , we are facing the below error :
##I IIS-DSEE-TFCN-00006 10:47:31(001) <main_program> conductor uname: -s=Linux; -r=2.6.18-164.el5; -v=#1 SMP Tue Aug 18 15:51:48 EDT 2009; -n=amsetl01; -m=x86_64
##I IIS-DSEE-TOSH-00002 10:47:31(002) <main_program> orchgeneral: loaded
##I IIS-DSEE-TOSH-00002 10:47:31(003) <main_program> orchsort: loaded
##I IIS-DSEE-TOSH-00002 10:47:31(004) <main_program> orchstats: loaded
##W IIS-DSEE-TOSH-00049 10:47:31(005) <main_program> Parameter specified but not used in flow: DSProjectMapName
>##E IIS-DSEE-TFIP-00050 10:47:31(007) <Data_Set_4> Error when checking operator: When binding output schema variable "outRec": Cannot drop the case from tagged output; case "t.encoded".
##W IIS-DSEE-TFIP-00093 10:47:31(008) <Data_Set_4> Error when checking operator: The modify operator has a binding for the non-existent output field "a".
##W IIS-DSEE-TFIP-00093 10:47:31(009) <Data_Set_4> Error when checking operator: The modify operator has a binding for the non-existent output field "b".
>##E IIS-DSEE-TFIP-00050 10:47:31(010) <Data_Set_4> Error when checking operator: When binding output schema variable "outRec": Cannot drop the case from tagged output; case "t.schema".
>##E IIS-DSEE-TFIP-00050 10:47:31(011) <Data_Set_4> Error when checking operator: When binding output schema variable "outRec": Cannot drop the case from tagged output; case "t.noPreservePartitioning".
##W IIS-DSEE-TFIP-00096 10:47:31(012) <Data_Set_4> Error when checking operator: The modify operator keeps field "a" which is not present in the output interface.
##W IIS-DSEE-TFIP-00096 10:47:31(013) <Data_Set_4> Error when checking operator: The modify operator keeps field "b" which is not present in the output interface.
>##E IIS-DSEE-TFIP-00058 10:47:31(014) <Data_Set_4> Error when checking operator: When binding output schema variable "outRec": Output tag case 0 is not associated with any concrete tag case.
>##E IIS-DSEE-TFIP-00058 10:47:31(015) <Data_Set_4> Error when checking operator: When binding output schema variable "outRec": Output tag case 1 is not associated with any concrete tag case.
>##E IIS-DSEE-TFIP-00058 10:47:31(016) <Data_Set_4> Error when checking operator: When binding output schema variable "outRec": Output tag case 2 is not associated with any concrete tag case.
>##E IIS-DSEE-TFSR-00019 10:47:31(017) <main_program> Could not check all operators because of previous error(s)
>##E IIS-DSEE-TCOS-00029 10:47:31(018) <main_program> Creation of a step finished with status = FAILED.
Please help to resolve this.
Regards,
Hema K
Issue with Decode stage
Moderators: chulett, rschirm, roy