Reading multiple files from a sequential file stage

Hope · Post by **Hope** » Thu Jun 19, 2008 11:45 am

I am trying to read multiple files from a sequential file stage.If I try to read one file at one time I can view the data.But If I specify read method to Specific File(s) and read all the files then aso I can view the data for all the files but I find a special charater at the beginning of the file (ie the 1st record of the file has a special character )when I view the data .Do I need to specify any file delimiter if so what is the option?.
Please advice.

Thanks

Hope · Post by **Hope** » Fri Jun 20, 2008 10:51 am

The files names are all different so I am using specific files.

Please advice

sreddy · Post by **sreddy** » Fri Jun 20, 2008 1:30 pm

Hope

You are using MFile stage

Hope wrote:I am trying to read multiple files from a sequential file stage.If I try to read one file at one time I can view the data.But If I specify read method to Specific File(s) and read all the files then aso I can view the data for all the files but I find a special charater at the beginning of the file (ie the 1st record of the file has a special character )when I view the data .Do I need to specify any file delimiter if so what is the option?.
Please advice.

Thanks

Hope · Post by **Hope** » Sat Jun 21, 2008 9:15 am

I am using Sequential file stage .This is a parallel job.

chulett · Post by **chulett** » Sat Jun 21, 2008 9:22 am

So... you can't use a File Pattern, even one like '*' or '*.csv' to read them?

Hope · Post by **Hope** » Sat Jun 21, 2008 2:07 pm

I am having 5 columns in all these files.In one of the file 2 columsn have no value.so I set the NULL FEILD VALUE for these columns as '' .And I am able to read these files.

Thanks for responding.

Raamc · Post by **Raamc** » Sat Jun 21, 2008 2:24 pm

Why can't we use *. and *.csv formats in file pattern.

I have used the follwoing in my jobs.
SOURCE:
FILE PATTERN: #pSOURCE#/BRANCH_NUMBER/*.*

to read set of 10 text files and it has worked.

ray.wurlod · Post by **ray.wurlod** » Sat Jun 21, 2008 4:28 pm

Depends what "the file names are all different" actually means. If they are sufficiently different that no suitable wildcard pattern can be found, then multiple File properties with a mode of Specific File is likely to be preferred.

chulett · Post by **chulett** » Sat Jun 21, 2008 6:42 pm

Assuming they are all located in the same directory, no matter how 'sufficiently different' their filenames were, a suitable wildcard pattern could be "*" or "*.*", I would think. Unless there are other filenames that should not be picked up at the same time, of course.

I'm guessing that the multiple Specific File option is more about files in multiple locations or cherry-picking files out of the herd from the same location than just the fact that their names are all different.

DSXchange

Reading multiple files from a sequential file stage

Reading multiple files from a sequential file stage

Re: Reading multiple files from a sequential file stage