File Transfer

dsscholar · Post by **dsscholar** » Tue Oct 30, 2007 1:04 pm

We transfer various source files on the unix server and a generic trigger file. This trigger file is used as an indication to start the load. The problem is that once a file is transferred along with a trigger file the job is kicked off and starts processing all the files that are present on the server. The problem occurs if another source file also starts getting transferred,it is also be picked up even if the transfer is not complete. Is there a way to check whether the file is completely transferred or not ?

chulett · Post by **chulett** » Tue Oct 30, 2007 1:15 pm

Perhaps you should rethink your idea of a generic trigger file.

There are various techniques. One it to check the incoming filesize at regular intervals and then process the file once it 'stops growing'. Not ideal, but I've seen it done. Another is to use a utility like fuser which purports to tell you if a file is 'in use' or not.

ArndW · Post by **ArndW** » Tue Oct 30, 2007 5:15 pm

Two other approaches are:
1. copy the file to a temporary name. Once copy is complete change the name.
2. Create the file with no privileges to anyone but the writing process. Once copy is complete change the privileges to grant access.