Performamnce of compilation

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
verify
Premium Member
Premium Member
Posts: 99
Joined: Sun Mar 30, 2008 8:35 am

Performamnce of compilation

Post by verify »

Hi,

We have installed datastage on RHLinux

Environment:

datastage v 8.01 - on RH linux 4 update 5 (no patches)


Scenario 1: Job is having 3 stages.

Seq ---->>>> Transformer ---->>>> oracle database

Login Time : 3 min

Open folder : 4 min

Designing Job : 4 min

Compiling a job : 10-14 min

Running a job : 4-5 min

Scenario 2: Job is containing many stages ( Ex: sequence )

Login Time : 3 min

Open folder : 4 min

Designing Job : 30 min

Compiling a job : 3 hrs

Running a job : 15 min

Ping response from client to server is 60 ms. It looks to me something went wrong in our installation. I am just wondering if it is a normal behaviour or something abnormal?

Thanks
RK Raju
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

try compiling a job with no transform stage to get a baseline compile time. Those numbers are absolutely atrocious and I couldn't work on a system like that. At my current site we have a big job that cannot be split due to technical reasons that takes 10-15 minutes to compile but that is the worst I've ever encountered.
Post Reply