compress and encode

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vamsi.4a6
Participant
Posts: 334
Joined: Sun Jan 22, 2012 7:06 am
Contact:

compress and encode

Post by vamsi.4a6 »

encode and compress stage understanding

I already read following link and just want to know mu understanding is correct or not?

viewtopic.php?p=363987

1)compress stage is used to compress the data and it won not support encryption

2)Encode stage is used to encrypt the data and it won not support compression

I/P FILE

col1,col2
1,A
2,B
3,C
4,D

Sequential_File_19: Error when checking operator: At field "t": Tagged aggregate must have a prefix or link reference

In documentation i read this but not understood how to proceed further a

sequential file-->compress-->sequential file

The schema for the compressed data set would be:
record
( t: tagged {preservePartitioning=no}
( encoded: subrec
( bufferNumber: dfloat;
bufferLength: int32;
bufferData: raw[32000];
);
schema: subrec
( a: int32;
b: string[50];
);
vamsi.4a6
Participant
Posts: 334
Joined: Sun Jan 22, 2012 7:06 am
Contact:

Post by vamsi.4a6 »

Any input on the above post.input is really appreciated
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

OK. Initial advice is "don't push - especially not on weekends".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Compress and Encode stages operate on data sets and as per the product manual, repartitioning is not allowed. Try them in conjunction with the Data Set stages.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply