Source Files not available - error handling

anu123 · Post by **anu123** » Mon Feb 20, 2006 3:48 pm

Hi all,

I have 3 different source files which are supposed to be FTPed to my server every month, then I load them into 3 seperate staging tables. From 3 staging tables,after doing some math, i need to load final table every month.

My requirement is, I need to look whether I have received all the 3 files then only I need to move further, I mean do the match and load final table.

wondering any of you implemented this functionality before....?

thanks in advance,

kcbland · Post by **kcbland** » Mon Feb 20, 2006 4:34 pm

There's no functionality inherent in the products for monitoring file availability. There are various methods, some using Unix scripts, others using DS BASIC or Sequencers, for detecting the presence of files. No matter what, you will program your own solution. As far as what I would do, I would write a watcher script to use a parameter driven list of files and their expected arrivals and use that watcher script to notify and act accordingly to either the presence or lack there of a given file.

anu123 · Post by **anu123** » Mon Feb 20, 2006 5:48 pm

kcbland wrote:There's no functionality inherent in the products for monitoring file availability. There are various methods, some using Unix scripts, others using DS BASIC or Sequencers, for detecting the presence of files. No matter what, you will program your own solution. As far as what I would do, I would write a watcher script to use a parameter driven list of files and their expected arrivals and use that watcher script to notify and act accordingly to either the presence or lack there of a given file.

thanks for the quick reply Bland.

Could please provide some more info. on "how to do this in Sequencers'..?Even my jobs are completely parameterized.

Is there any DS Documentation, where I can find some info.?

rasi · Post by **rasi** » Mon Feb 20, 2006 5:54 pm

Anu

While creating Sequence you have a plug-in called Wait_For_File_Activity this will help you to wait for the file to appear or disappear on defined folder.

I_Server_Whale · Post by **I_Server_Whale** » Mon Feb 20, 2006 6:21 pm

Hi Anu,

You can create a "Sequence job" which has three 'wait-for-file activity stages, followed by a 'job sequencer' stage, followed by three 'job activity' stage for running the jobs which load the staging tables and then a final 'job activity' stage for running the job to load your target table.

It may be the case that you may have more jobs to run to load the staging as well as your target tables. In that case, you need to include all of those jobs by adding additional 'job activity' stages appropriately.

Make sure that the mode in your 'job sequencer' stage is set to all, there by confirming the existence of all three source files.

I have created a sample design. Please feel free to download it from:

http://s39.yousendit.com/d.aspx?id=22IH ... BJ0NR8PMTP

Thanks,
Naveen.

anu123 · Post by **anu123** » Mon Feb 20, 2006 6:26 pm

naveendronavalli wrote:Hi Anu,

You can create a "Sequence job" which has three 'wait-for-file activity stages, followed by a 'job sequencer' stage, followed by three 'job activity' stage for running the jobs which load the staging tables and then a final 'job activity' stage for running the job to load your target table.

It may be the case that you may have more jobs to run to load the staging as well as your target tables. In that case, you need to include all of those jobs by adding additional 'job activity' stages appropriately.

Make sure that the mode in your 'job sequencer' stage is set to all, there by confirming the existence of all three source files.

I have created a sample design. Please feel free to download it from:

http://s39.yousendit.com/d.aspx?id=22IH ... BJ0NR8PMTP

Thanks,
Naveen.

Hey Naveen,

It looks great..thanks for your time and .pdf..
I will work on it and let u update....