check job status in routine without waiting for completion

[wuruima]

Hi all.

In a routine, I use a for loop to trigger parallel jobs. I would like these jobs to run in parallel instead of in sequentially.

But how can I detect the status of the jobs at the end of the routine?

I need to make sure the parallel jobs completed successfully and then finish the routine processing.

[wuruima]

I don't want to run DSWaitForJob every time. the jobs could run at the same time.

[chulett]

Set up (or find) a Sequence job with multiple unconnected Job Activity stages. No need to actually run it but rather examine the job control code that it generates. From what I recall, you should be able to find the code where it starts all of the jobs and then issues a single DSWaitForJob function call with a list of all of the PIDs running to wait for.

Meaning it is possible and the code for it is out there... or can be.

[UCDI]

would a sequencer work, where you fed all the jobs that start at once into a single sequencer and checked after that to see if you can proceed?

I have not done this, its just an idea to try.

[chulett]

Nope, at least not via a Job Activity stage which automatically does a "wait" making them run in a serial manner. At least that's what I recall. It would provide a gate, however, and not proceed until all are complete (assuming it is set that way) but won't affect parallel versus serial in the running of the jobs coming into it.

[Teej]

Plus there are a number of settings that limit the actual number of jobs being kicked off by the Job Sequencer. I do not have a reference handy to help guide you just yet, but this is tunable.

Have you considered using Workload Manager to help manage your resources (available in 9.1+), while throwing out as many jobs as you can?

-T.J.

[ray.wurlod]

DSWaitForJob() can wait for multiple jobs.

Review the job control code generated by a sequence job to see how (essentially a dynamic array of job handles).

[chulett]

As noted earlier.

[wuruima]

very useful. Thanks all.

[UCDI]

"It would provide a gate, however, and not proceed until all are complete"

Right, this is what I was thinking -- for simple needs, it would be sufficient, if all you need is "wait for 1-5 before kicking off 6".

[chulett]

Yes, true... that is exactly what they are for.