Best way to Log a File's Arrival

[ashishm]

My functional requirement is that if a source file arrives at any time, I create a record in a transmission logfile, with the information about the filename.The Input file has over 8 million records in it, so I dont want a stage which reads the whole file as it may slow processing time, and i have to write only one Output row.


Is there a way to do this in DataStage 8.1? The client cant be persuaded to write a shell script.

[SURA]

It will arrive one after another / at the same time ?

DS User

[ashishm]

It will arrive one after another / at the same time ?

DS User

It will arrive one after the other.So the case is let's say if a file arrives in morning, i insert a record in transmisison log,
If the file comes again, I insert another record in the same transmission log

[ashishm]

It will arrive one after another / at the same time ?

DS User

So this is what I have in mind,

I will keep a dummy file, and in the sequencer, check whether the Input file has arrived, using file watcher, if it has arrived, I will Just write an Input row using a Transformer to the Log

[ray.wurlod]

In a Routine activity invoked from a sequence (which might include a Wait For File activity) you can use the OpenSeq statement to open the file (without reading it), then the STATUS statement can return the file's size and lots of other information about the file. Once you have that, simply close the file.