Parallel Execution of Routine in Sequence job

bi_fujitsu · Post by **bi_fujitsu** » Wed Apr 01, 2009 10:40 am

Hi,

I have sequence having following flow

RTN1----------------------->Job1
RTN2----------------------->Job2
RTN3----------------------->Job3
RTN4----------------------->Job4
RTN5----------------------->Job5
RTN6----------------------->Job6

RTN1 to RTN6 are the routine activity which looks for the Source file and if the file is not present it remains in loop and keeps on looking for the file. Once the file is found it kick off the load jobs. The problem is that if say the file for RTN3 has not arrived and it remains in loop. The RTN4 to RTN6 does not get initiated. My requirement is that if RTN3 goes into loop due to non-availability of the file all the remaining RTN's and their corresponding jobs should get kicked off. RTN3 is just an example it could happen that on some day RTN1 goes into loop due to non-availability of the file.

Please let me know how i can achieve this functionality.

narasimha · Post by **narasimha** » Wed Apr 01, 2009 11:37 am

If you place all these activities in the Job Sequence as is, stick in a Sequencer_Condition linking all the jobs with an "ALL" mode (Followed by a Notification Activity if you need) you should be good.

bi_fujitsu · Post by **bi_fujitsu** » Wed Apr 01, 2009 12:24 pm

I tried using a Sequencer with "ALL" option but its not working.........

narasimha · Post by **narasimha** » Wed Apr 01, 2009 12:45 pm

In the above design, all the Routine_Activities should kick off simultaneously.
Can you provide details as to what is not working?

bi_fujitsu · Post by **bi_fujitsu** » Wed Apr 01, 2009 1:24 pm

The problem is that if RTN3 is looking for file "ABC" and it hasn't arrived then the sequence just waits for the RTN3 to complete but i want that all RTN1 to RTN6 should execute in parallel and if there are source files for all of them except RTN3 it should go ahead execute their individual load jobs also so that in the end i am only left with RTN3 in running condition.

just4geeks · Post by **just4geeks** » Wed Apr 01, 2009 3:43 pm

Please provide a snapshot of how your design looks like in designer. What narsimha suggested should work.

Kryt0n · Post by **Kryt0n** » Wed Apr 01, 2009 4:22 pm

I guess that is because the routines are handled by the sequencer i.e. doesn't spawn a process to do the routine...

Try create a sequential job that runs the routine and the pj then call this sequential job 6 times (assuming you can differentiate with parameters)

bi_fujitsu · Post by **bi_fujitsu** » Thu Apr 02, 2009 9:33 am

I am a bit new to Datastage. Can you please eloborate a bit because i am not able to make out how you can call just the routine in a job.

I just want to execute the routines in parallel. What would be the design of my job to call these 6 routines in 6 different jobs.

Thanks for all the support.

ray.wurlod · Post by **ray.wurlod** » Thu Apr 02, 2009 1:04 pm

Six sequences each invoking routine, those six sequences called from master sequence.

bi_fujitsu · Post by **bi_fujitsu** » Thu Apr 02, 2009 3:25 pm

Hi Ray,

Thanks for your support. I did exactly the way you told me and its working now.

narasimha · Post by **narasimha** » Thu Apr 02, 2009 4:57 pm

Wonder why the design which I suggested did not work for you?
Probably it just needed Ray's touch.

ray.wurlod · Post by **ray.wurlod** » Thu Apr 02, 2009 5:43 pm

Routines are executed synchronously in the same process as the sequence itself. That is, the sequence waits for a routine to finish before moving on to any other activity.

Placing the routines in separate sequences obviates that wait in the master sequence.