datatype of compressed data.

kalpna · Post by **kalpna** » Thu Mar 16, 2006 7:55 am

Hi!
Can anyone tell me what is the sql datatype for compressed data??

Thanks
Kalpna.

chulett · Post by **chulett** » Thu Mar 16, 2006 8:02 am

Define what you mean by 'compressed data'.

kumar_s · Post by **kumar_s** » Thu Mar 16, 2006 8:12 am

How about VarBinary or LongVarBinary ?

kalpna · Post by **kalpna** » Thu Mar 16, 2006 8:25 am

kumar_s wrote:How about VarBinary or LongVarBinary ?

No! tried both!! it doesn't work

Thanks
Kalpna

DSguru2B · Post by **DSguru2B** » Thu Mar 16, 2006 8:50 am

Probably there is a seperate utility to Unzip MQ compressed XML files.

kalpna · Post by **kalpna** » Thu Mar 16, 2006 8:55 am

DSguru2B wrote:Probably there is a seperate utility to Unzip MQ compressed XML files.

No! its not MQ compressed data..its of gzip.

kalpna · Post by **kalpna** » Thu Mar 16, 2006 9:02 am

adding to that..

when i use bit datatype and try unzipping it..
it says..
unexpected end of file..
does that mean it recognised the format..now.
same with unknown datatype.

kumar_s · Post by **kumar_s** » Thu Mar 16, 2006 9:03 am

Can you uncompress the same file using the mentioned command from command prompt with out any issue?

kalpna · Post by **kalpna** » Thu Mar 16, 2006 9:12 am

kumar_s wrote:Can you uncompress the same file using the mentioned command from command prompt with out any issue?

i am passing the compressed file(using gzip) to the quque from command line only..(for testing)
MQ does not change the content...
but, when i get the same message from the queue, (there i need to define the datatype)..the output is different from datatype to datatype.

i know! it happens when you try to convert binary to string..etc..

but, what is the data type with which we can handle compressed data?

ArndW · Post by **ArndW** » Thu Mar 16, 2006 10:43 am

compressed data is binary. The first bytes of the file determine what the type is, so in your case the first packet (and most likely all subsequent ones) are being mangled. Can you output the mqseries compressed data straight to a unix file without using datastage? I am willing to bet that it isn't coming in correctly there, either. Binary datatypes in DS mean that the data is not modified in any way.

kalpna · Post by **kalpna** » Fri Mar 17, 2006 5:01 am

ArndW wrote:compressed data is binary. The first bytes of the file determine what the type is, so in your case the first packet (and most likely all subsequent ones) are being mangled. Can you output the mqseries compressed data straight to a unix file without using datastage? I am willing to bet that it isn't coming in correctly there, either. Binary datatypes in DS mean that the data is not modified in any way.

Arnd!
I tried retreiving message directly from queue to unix box.
it works fine..and I'm able to unzip it.

Thanks
Kalpana.

ArndW · Post by **ArndW** » Fri Mar 17, 2006 5:17 am

I'm at loss in that case; I don't know why you are getting mangled data. Can you work around it by copying and gunzipping outside of DataStage?

kalpna · Post by **kalpna** » Fri Mar 17, 2006 5:23 am

ArndW wrote:I'm at loss in that case; I don't know why you are getting mangled data. Can you work around it by copying and gunzipping outside of DataStage? ...

Tried in Unix, tried in windows (as gzip and win zip are compatible)
works fine..
but, not the output from datastage...??

Kalpna.

kalpna · Post by **kalpna** » Fri Mar 17, 2006 5:44 am

I tried without MQ..
I mean.., i took a file zipped it(GZip), passed through the transformer with the data type binary and wrote to a file with extension .gz.

it does not recognise it as gzip format..

Any clues!!!!

Thanks
Kalpna.

kumar_s · Post by **kumar_s** » Fri Mar 17, 2006 6:46 am

kalpna wrote:I tried without MQ..
I mean.., i took a file zipped it(GZip), passed through the transformer with the data type binary and wrote to a file with extension .gz.

it does not recognise it as gzip format..

Any clues!!!!

Thanks
Kalpna.

What is the stage you use to read and write?
You can try using ComplexFlatFile and mark the Record Option - Data Format as Binary.
Same in the target.