Reading txt file with date in its name, in daily cycle

gssr · Post by **gssr** » Tue Oct 20, 2009 5:40 am

Hi all,
I have to read a txt file and load it to the database.This is daily cycle.
The file name is in the format say,SAMPLE_20091020.txt,SAMPLE_20091021.txt ..
I cant change the file name manually ...
How can i handle this situation of handling the file and getting the date from it.

Thanks in advance,
Raj

sajidkp · Post by **sajidkp** » Tue Oct 20, 2009 5:54 am

I think this is a common requirementYou can Parameterise the datepart of the file name.

If you are aware that what dates will come in files you can assign the value for date param from Sequencer and pass to the sequential file stage.

your File name in seq file property will look like

SAMPLE_#dataparam#.txt

chulett · Post by **chulett** » Tue Oct 20, 2009 5:54 am

Use the File Pattern option in the stage.

gssr · Post by **gssr** » Tue Oct 20, 2009 5:59 am

I searched for any topics regarding FILE PATTERN,
but i could find in dsxchange..
Can you please shre me the idea of using it or the thread that has the detail about it..

Thanks,
Raj

gssr · Post by **gssr** » Tue Oct 20, 2009 5:59 am

I searched for any topics regarding FILE PATTERN,
but i could find in dsxchange..
Can you please shre me the idea of using it or the thread that has the detail about it..

Thanks,
Raj

sajidkp · Post by **sajidkp** » Tue Oct 20, 2009 6:00 am

But, In that case how can it read yesterdays date's file? i think he had mentioned like daily files comes with the dates

gssr · Post by **gssr** » Tue Oct 20, 2009 6:00 am

I searched for any topics regarding FILE PATTERN,
but i could find in dsxchange..
Can you please shre me the idea of using it or the thread that has the detail about it..

Thanks,
Raj

ArndW · Post by **ArndW** » Tue Oct 20, 2009 6:04 am

Look into your online PDF "Parallel Job Developer Guide" and search for "file pattern".

sajidkp · Post by **sajidkp** » Tue Oct 20, 2009 6:07 am

Raj,

Do you want to disconsider the date part or you need to check the dates when reading from the file?

gssr · Post by **gssr** » Tue Oct 20, 2009 6:18 am

i have the date in the records itself, So there is no need to consider the date part...

gssr · Post by **gssr** » Tue Oct 20, 2009 7:04 am

But i should not run the yesterdays files again and again..?

Thanks,

gssr · Post by **gssr** » Tue Oct 20, 2009 7:06 am

But i should not run the yesterdays files again and again..?

Thanks,

chulett · Post by **chulett** » Tue Oct 20, 2009 7:34 am

Then you either need to rename the file once processed so it no longer matches your pattern, or you need to move it to another directory.

gssr · Post by **gssr** » Tue Oct 20, 2009 8:12 am

Is there any option other than renamiming the Production files....

chulett · Post by **chulett** » Tue Oct 20, 2009 8:29 am

Ummm... moving them to another directory? An 'archive' one would be typical. Harder would be to keep a list of filenames processed and skip those filenames when you see them again.