Load Multiple Files From FTP Location

Mayurgupta7744 · Post by **Mayurgupta7744** » Fri Jul 12, 2013 7:37 am

Hi All,

I need to download multiple files from FTP location into Local Machine. Can any one suggest one generic method which can be used while implementing the job in DataStage to perform this task.

Any help will be appriciated!

chulett · Post by **chulett** » Fri Jul 12, 2013 7:57 am

A UNIX script. And if you really need a DataStage job to run it, use a Sequence job. However, what does "local machine" mean here - the ETL server?

Mayurgupta7744 · Post by **Mayurgupta7744** » Sun Jul 14, 2013 8:50 pm

Hi,

By Local machine, i mean machine/node in which DataStage Server is installed. I wish to use DataStage stages for implementing this logic.

Recently i came across FTP Enterprise Stage which is use to load the files from FTP location to DataStage Server. Now the question is how can i load multiple files from FTP location to DataStage Server by using single job/FTP Stage?

MrBlack · Post by **MrBlack** » Mon Jul 15, 2013 11:22 am

I haven't tested this but in the FTP stage, could you just define a file pattern like

file_*.csv

Other options would be to

Use a sequence to loop through each file that needs processing. There's many ways you can define a list such as statically, OS scripting, or read in a master file from the FTP that would have a list of file names to process.

Instead of FTP, mount the location to your server and use the Folder Stage which you can use file patterns.