Job Compilation Notes

bharatmajeti · Post by **bharatmajeti** » Mon Nov 21, 2011 7:09 am

Hi,

I read one presentation, which is briefing about Datastage at a Higher level.

In "Compilation Notes", they wrote the following points.

On clustered / GRID environments:

Share the project directory to share Transformers
(Must be identical mount point across servers)
Or
set $APT_COPY_TRANSFORM_OPERATOR on first job run to distribute Transformer objects

Build stages must be shared, or distributed manually

Can anyone please explain the meaning in detail.

Thanks,
Bharath.

qt_ky · Post by **qt_ky** » Mon Nov 21, 2011 8:46 am

My understanding is that the compiled object code must be copied to each computer in your grid (distributed manually) so that the job can execute it.

jwiles · Post by **jwiles** » Mon Nov 21, 2011 10:22 am

It will depend upon how your storage is shared among the cluster/grid.

If your project directories and directories where custom code (build stages/custom operators/parallel C++ routines) is compiled are shared (cluster filesystem SAN or NFS) among the cluster members (using the same directory paths), then all members should see the same images and manual transport is unnecessary.

If your project directories and directories where custom code is compiled are NOT shared among the cluster members, then manual transport is necessary.

Regards,