Page 1 of 1

compress and encode

Posted: Fri Jun 27, 2014 9:06 am
by vamsi.4a6
encode and compress stage understanding

I already read following link and just want to know mu understanding is correct or not?

viewtopic.php?p=363987

1)compress stage is used to compress the data and it won not support encryption

2)Encode stage is used to encrypt the data and it won not support compression

I/P FILE

col1,col2
1,A
2,B
3,C
4,D

Sequential_File_19: Error when checking operator: At field "t": Tagged aggregate must have a prefix or link reference

In documentation i read this but not understood how to proceed further a

sequential file-->compress-->sequential file

The schema for the compressed data set would be:
record
( t: tagged {preservePartitioning=no}
( encoded: subrec
( bufferNumber: dfloat;
bufferLength: int32;
bufferData: raw[32000];
);
schema: subrec
( a: int32;
b: string[50];
);

Posted: Sun Jun 29, 2014 11:33 pm
by vamsi.4a6
Any input on the above post.input is really appreciated

Posted: Mon Jun 30, 2014 4:29 am
by ray.wurlod
OK. Initial advice is "don't push - especially not on weekends".

Posted: Mon Jun 30, 2014 5:37 am
by qt_ky
Compress and Encode stages operate on data sets and as per the product manual, repartitioning is not allowed. Try them in conjunction with the Data Set stages.