How to read multiple txt files into one sequential stage

4friends · Post by **4friends** » Wed Dec 12, 2007 12:47 am

Hi All,

How to read multiple txt files into one sequential stage

files such as
HIST_DATA_2005.txt
HIST_DATA_2006.txt
HIST_DATA_2007.txt

Same metadata

Is Datastage Server Edition capable of

Is there in Enterprise edition

Maveric · Post by **Maveric** » Wed Dec 12, 2007 12:52 am

Enterprise edition, yes. Server, not sure. Select Read Method to "File Pattern" and give the path and file name as path\HIST_DATA_200*.txt

Maveric · Post by **Maveric** » Wed Dec 12, 2007 1:02 am

If you read the help document, you will come to know that the sequential file stage in a server job will support multiple input and output links. And you can have one file for each of the output link. Use a link collector to get the data into one link.

This is use full only if the number of files remain constant.

4friends · Post by **4friends** » Wed Dec 12, 2007 1:08 am

Thanks Maveric

ray.wurlod · Post by **ray.wurlod** » Wed Dec 12, 2007 1:24 am

In parallel job Sequential File stage you can have multiple File properties for reading specific files, for File Pattern for reading files whose names match a given regular expression.