Read more than 1 sequential file

SURA · Post by **SURA** » Tue Oct 28, 2008 7:26 pm

Hi

Can any one suggest which will be the best way to read more than one sequential file? I have 4 files with different name, but with same metadata. Let me know how to read all these files in a time

Regards
Ram

ray.wurlod · Post by **ray.wurlod** » Tue Oct 28, 2008 8:36 pm

Use a Sequential File stage with a Filter command that turns all four files into a single bytestream, for example cat file1 file2 file3 file4

SURA · Post by **SURA** » Tue Oct 28, 2008 8:45 pm

ray.wurlod wrote:Use a Sequential File stage with a Filter command that turns all four files into a single bytestream, for example cat file1 file2 file3 file4 ...

Hi Ray

In that case what should i need to give in the File name ?

Regards
Ram

chulett · Post by **chulett** » Tue Oct 28, 2008 10:36 pm

/dev/null

ray.wurlod · Post by **ray.wurlod** » Wed Oct 29, 2008 8:53 am

Anything. The File Name is ignored when a Filter command is used; stdout of the command is read by the stage. The fact that the File Name field has to be populated is merely annoying.

chulett · Post by **chulett** » Wed Oct 29, 2008 9:09 am

No, it's not ignored. You can, for example, put "fred" for the filename and simply "cat" for the filter and it will combine the two and "cat fred" automatically. That's why I tend to put "/dev/null" for the filename when its included in the filter command as it makes it more obvious that it's not used and it doesn't seem to get in the way of things.