Different Config Files for Sequence and Child Job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nvalia
Premium Member
Premium Member
Posts: 180
Joined: Thu May 26, 2005 6:44 am

Different Config Files for Sequence and Child Job

Post by nvalia »

Hi,

JobA uses a 1 Node Config file by setting the ENV Var $APT_CONFIG_FILE to point to different config file (instead of the default.apt) in the job and it works fine. But now when we call this job in a Sequence we need to add this Env Var to the Sequence as well and set it to use 1Node file and finally pass this to the JobA.

This works fine but this means all jobs in the Sequence (JobB, JobC) will also run on 1 Node impacting performance

How we can have only this job run on one node but all other jobs in the Sequence run on regular 2 node configuration?

Thanks
lstsaur
Participant
Posts: 1139
Joined: Thu Oct 21, 2004 9:59 pm

Post by lstsaur »

Use 2 nodes config file, but set jobA's Node pool and resource constrains to 1 particular node.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Why not pass hard-coded replacement values (pathnames of configuration files) to the jobs in the Job activities that invoke them?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
BI-RMA
Premium Member
Premium Member
Posts: 463
Joined: Sun Nov 01, 2009 3:55 pm
Location: Hamburg

Post by BI-RMA »

Another alternative is to create a parameter-set containing $APT_CONFIG_FILE.

Have value-files pointing to the different Configurations you want to choose from for different jobs. You can then configure each activity to use its individual configuration by choosing the appropriate value-file.

While being fairly similar to actually hardcoding a specific path as Ray suggested, this solution makes it possible to have a value-file TWO_NODE that points to two different configuration-files in two different projects. This way you do not need to change any values on the sequence and recompile after transporting a job from a development- to a test-environment, which may both be located on the same physical machine but use different resources specified in different configuration-files.
"It is not the lucky ones are grateful.
There are the grateful those are happy." Francis Bacon
nvalia
Premium Member
Premium Member
Posts: 180
Joined: Thu May 26, 2005 6:44 am

Post by nvalia »

Thank You all, this helps.
Post Reply