Loading a zipped File

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Lotus26
Premium Member
Premium Member
Posts: 48
Joined: Tue Jul 13, 2004 2:09 pm

Loading a zipped File

Post by Lotus26 »

HI

I have a big file which comes from a source in zipped format . If I try to unzip , it is giving an error because of the space issues .

So with out unzipping the file , is there any way to read the file in datastage?

Thanks.
Regards
Lotus26
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I guessing you could use the Filter option in the Sequential File stage to unzip the file to standard out and then consume the stream. No idea how much temp space, if any, that would still require.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

As Craig has already pointed out, use the filter option in the sequential file stage. If your source file is "a.Z" then the filter option would read

Code: Select all

uncompress -c
and the compressed file is read and uncompressed in memory to the DataStage job.
Lotus26
Premium Member
Premium Member
Posts: 48
Joined: Tue Jul 13, 2004 2:09 pm

Post by Lotus26 »

Thank you for your help . I used the gzip -cd option in the filter and it did worked fine .
Regards
Lotus26
Post Reply