Issue while reading file with pattern

[Abhijit_JU]

In our production run time, we are facing some issues while reading files with pattern. It is giving one warning masage :

SQ_Merge_PHYSICAL_CHARGE_INFO,0: Couldn't find any files on host SVHJ0029 with pattern /data02/prepaid/apps/SCPDB/Outgoing/DEL/DL_CS_ND00_20090423160039_0000_12690_LoadReady_PHYSICAL_CHARGE_INFO*.dat

but all files are their in the required dir location. If we rerun the job it gets the files and read them properly. This job is running 12 times in a day but this problem we are getting almost once in 2-3 days, sometime that frequency increases.

Files with that pattern are getting generated by other jobs (with diffrent apt_config_file) in the seq before this job (where we are reading the files with pattern).

Is it because of the network issue (when trying to read the file from storage connetion is getting disrupted anyway) or it is because of any other thing?

I would be really greatful if anyone please give some clue on this.

One more thing is it possible to fail the job (while reading with pattern) when it does not get any file with that pattern.

[ShaneMuir]

In our production run time, we are facing some issues while reading files with pattern. It is giving one warning masage :

SQ_Merge_PHYSICAL_CHARGE_INFO,0: Couldn't find any files on host SVHJ0029 with pattern /data02/prepaid/apps/SCPDB/Outgoing/DEL/DL_CS_ND00_20090423160039_0000_12690_LoadReady_PHYSICAL_CHARGE_INFO*.dat

but all files are their in the required dir location. If we rerun the job it gets the files and read them properly. This job is running 12 times in a day but this problem we are getting almost once in 2-3 days, sometime that frequency increases.

Files with that pattern are getting generated by other jobs (with diffrent apt_config_file) in the seq before this job (where we are reading the files with pattern).

Is it because of the network issue (when trying to read the file from storage connetion is getting disrupted anyway) or it is because of any other thing?

I would be really greatful if anyone please give some clue on this.

Is it possible that its a timing issue? Ie that all the files that are there are being removed by some other process?

One more thing is it possible to fail the job (while reading with pattern) when it does not get any file with that pattern.

Its definitely possible - the solution would all depend on how you are calling your jobs/scripts etc.

[ithirak_17]

It must be netowrk issue or the server may down at your time running or the file with the particular pattern is not created.

The file name from your mail shows that the date pattern is available when the particular file is running on the other day of server time it will not fetch that file..

So check the time of the process running.

You can able to stop the process when the file is not available.If you are running in unix then check for the presence of file and end the program.