Import and Compile of large number of jobs

Pete Morris · Post by **Pete Morris** » Fri Apr 20, 2007 3:12 am

We are trying to import 2000 job designs using DS manager and then compile them.
It is taking 5 hours to complete the import and 2 hours to compile them.
The jobs already exist in the target project but are being updated with new versions.

Is there any way i can speed up the process.

ivannavi · Post by **ivannavi** » Fri Apr 20, 2007 3:28 am

I'm afraid not. Version control will also be slow.

ray.wurlod · Post by **ray.wurlod** » Fri Apr 20, 2007 4:15 am

You can speed up the import by checking "overwrite without query" and deleting the existing (old) versions first. Make sure that you have a backup, of course.

You can speed up the compilation by having more than one Multi-Job Compile session running, each compiling a disjoint set of the jobs. Takes a bit of planning, but shouldn't be too difficult - for example filter on the first letter of the job name.

Pete Morris · Post by **Pete Morris** » Fri Apr 20, 2007 4:22 am

Thanks Ray.

chulett · Post by **chulett** » Fri Apr 20, 2007 6:59 am

There were 'multi-job compilers' available before the official one from Ascential. They were much more light weight and so ran much faster, I wonder if any of them are still around. MJC is like, the slowest.

Didn't DSC offer such a thing at one point? Also, Kenneth Bland's Job Control Utilities includes such a utility implemented as a batch job. Way more faster.

kduke · Post by **kduke** » Fri Apr 20, 2007 3:13 pm

There you go. "Way more faster." You don't get a more better recommendation than that.

chulett · Post by **chulett** » Fri Apr 20, 2007 3:15 pm

Yah, man - way more much betta.

kduke · Post by **kduke** » Fri Apr 20, 2007 3:35 pm

You made my day. Thanks dude.