Zip Seq file

joyson · Post by **joyson** » Tue Oct 17, 2006 12:08 am

Hi All

Am getting Seq files in Zip format. The requirement is shd not unzip those files manually..shd have to be implemented in DataStage iteslf.

Any one advice me

Thanks
Joy

Kirtikumar · Post by **Kirtikumar** » Tue Oct 17, 2006 12:58 am

In the sequential file stages there is something called as command filter. You can use the command filter in the seq file stage to first uncompress the data and then use this uncopressed file in the file name for the stage. In the command filter you use the any decompression utility lie tar or gzip etc.

There is one more option - use a before job routine to do decompression.

DSguru2B · Post by **DSguru2B** » Tue Oct 17, 2006 6:40 am

Depending upon the what kind of zip it is (the extension, .tar, .Z or .gz) you will have to supply the proper command in the before job subroutine as KirtiKumar mentioned.

joyson · Post by **joyson** » Tue Oct 17, 2006 6:45 am

Hi Kumar

Here in my env the filter command is disabled.Could you pls.. let me know with the coding for before job sub-routine

Thanks
Joy

DSguru2B · Post by **DSguru2B** » Tue Oct 17, 2006 6:56 am

As i said, the coding depends upon the type of zip it is
if its .tar then

Code: Select all

untar file.tar

if its .Z then

Code: Select all

uncompress file.Z

it its .gz then

Code: Select all

gzip -d file.gz

These command(s) will go in the after job subroutine "ExecSh"

joyson · Post by **joyson** » Tue Oct 17, 2006 7:00 am

Hi DSGuru
Thanks for your reply
Could you pls..tell me how to do this with Filter command

Thanks
Joy

chulett · Post by **chulett** » Tue Oct 17, 2006 7:02 am

joyson wrote:Here in my env the filter command is disabled.

Rather than seaking another route, why not just enable it? It's just a check box on the stage to light it up and start using it.

Otherwise, you're back to writing Before Job routines or shell scripts and we all remember how much fun that is.

joyson · Post by **joyson** » Tue Oct 17, 2006 7:34 am

Now the filter command is enabled!
Then what to do for unzipping my SRC Seq files

Please advice

Thanks
Joy

chulett · Post by **chulett** » Tue Oct 17, 2006 8:02 am

Have you read the Help associated with the Filter option? You can't just simply 'unzip' anything there, you need to find a way to provide the contents of all files to 'standard out' so the Sequential stage can read the stream of data as if it were a file.

If all you want to do is unzip something, do that before job or in a separate step.

joyson · Post by **joyson** » Tue Oct 17, 2006 8:58 am

Hi

I went through the filter command help , but i did't get any solution for the my requirement.
Can anyone advice me

Thanks
Joy

kcbland · Post by **kcbland** » Tue Oct 17, 2006 9:22 am

If multiple files are inside an archived file format, you are going to have a lot of trouble doing a simple uncompression into a Sequential stage.

The filter command has to return streaming output to a pipe, that's its mechanism. You have to uncompress but not to a file, but to stdout. Furthermore, you must also specify a single file to be uncompressed, if the archive holds multiple files you must be able to specify the one you need.

The boundaries for your task are suspect. You should simply uncompress the files and process them naturally using a Sequential stage. That's as much help as I'm willing to give, because I believe you should fight the directive to process as archives.

dsscholar · Post by **dsscholar** » Fri Oct 20, 2006 11:16 am

Please see if the below code helps..I am doing something sinilar in a server routine...

inrec=Trim(Arg1)
len1=LEN(inrec)
len2=len1-2
file1=inrec[len2,3]

if (file1 = 'zip' or file1 = 'ZIP') then
ucom1 ='unzip /pathname'
ucom1=CATS(ucom1,inrec)
ucom1=CATS(ucom1," -d pathname")

CALL DSExecute('UNIX',ucom1,fil1,SYSRET)

ucom1 ='rm /pathname'
ucom1=CATS(ucom1,inrec)
CALL DSExecute('UNIX',ucom1,fil1,SYSRET)
end

You may need to modify the code a bit !! I am passinf the name of the file a an argument to the code..