How to Read multile .csv files in Sequential stage

gooogle · Post by **gooogle** » Thu Jul 21, 2011 4:42 pm

I have files in a folder in this format:
20110701.csv
20110702.csv
.....
20110715.csv

In the sequential file stage I have
\\srcfolder\201107*.csv

But it wont work.

It works if I give a specfic file name:
\\srcfolder\20110701.csv

Any help appreciated ....

ray.wurlod · Post by **ray.wurlod** » Thu Jul 21, 2011 6:26 pm

Do you change the method from Specific File to File Pattern when you use the wildcard character? What do you mean by "doesn't work"?

VVVRAVINDRA999 · Post by **VVVRAVINDRA999** » Thu Jul 21, 2011 7:34 pm

change the forward slash to backward slash and give a try

ray.wurlod · Post by **ray.wurlod** » Thu Jul 21, 2011 8:10 pm

VVVRAVINDRA999 wrote:change the forward slash to backward slash and give a try

What forward slash?

gooogle · Post by **gooogle** » Thu Jul 21, 2011 9:46 pm

The job is failing with the error that the file name 201107*.csv not found in the given location

Any ideas anyone ?

SURA · Post by **SURA** » Thu Jul 21, 2011 9:50 pm

Datastage cant find this file name at all.

Let us know the detail info like, what you have mentioned in the stage level.

Then it will be easy to guide.

DS User

chulett · Post by **chulett** » Thu Jul 21, 2011 10:29 pm

Answer the question Ray asked - do you change the method from Specific File to File Pattern when you use the wildcard character?

gooogle · Post by **gooogle** » Fri Jul 22, 2011 8:23 am

Inside the Sequential file stage I have
Source - \\ladiappd01\etl_src_files\EDW\Work_Folder\201107*.csv
Read Method - File pattern

In the source folder I have
20110701.csv
20110702.csv
....
20110719.csv

Can DataStage get all the files and run it or I need to manuall add the next date (\Work_Folder\20110701.csv)
& run it 19 times ?

vijaykumarpj · Post by **vijaykumarpj** » Fri Jul 22, 2011 2:02 pm

Try using Source - \\ladiappd01\etl_src_files\EDW\Work_Folder\201107* and make sure that the property is set to comma as a delimiter.

chulett · Post by **chulett** » Fri Jul 22, 2011 2:20 pm

While 201107* may work in UNIX, it won't match files in Windows without specifying an extension as well - meaning 201107*.* would be what you should try. I don't think it will help but can't hurt to try.

Now, I'm curious - why the UNC path? Are you looking for files on a remote server? I wonder if that is part of the issue...

vijaykumarpj · Post by **vijaykumarpj** » Sat Jul 23, 2011 7:59 pm

I guess, Datastage will try to read the files from the Unix server itself. Hence, 201107* should work. Pls try and let me know if the issue persists.

SURA · Post by **SURA** » Mon Jul 25, 2011 12:29 am

Place only one file in that folder and try to read *.csv

DS User

DSXchange

How to Read multile .csv files in Sequential stage

How to Read multile .csv files in Sequential stage

NEW TO DATASTAGE

Re: NEW TO DATASTAGE