DSXchange

I'm getting slow responses from compiling my Datastage job sequences. They take about 30 minutes.

I have removed the calling of routines via the routine stage and put them in a user variable stage instead. This helps but still they are pretty slow

Admittedly, there are 40 jobs in the sequence with 80 routine calls. We are obliged to keep the job sequences big as they are grouped by functionality.

That is disturbing. Is your client by any chance very, very remote from the server, perhaps using an old style dial up connection?

Have you checked on Fix Central or with Support to see if there is any patch available?

We have looked at a few patches but they only seem to relate to PX jobs not Job Sequences as they mention BUILDOP flags.

There were others but they were for 8.7 DB2 connectors, which again we dont have.

What version are you on?

How does your compile time compare to a client that is "right next door" (on the network) to your DataStage server?

We are using version 9.1.0.1 but as I mentioned the PX jobs with many stages in compile in no time at all its only the job sequences.

We thought it might be a project issue so we imported the objects into another project but still have the same issue.

Raise a ticket with your official support provider.

Since this is specifically about Sequence jobs, pushed this over to the General forum. Carry on.

Question: Does this behavior occur for every developer? Is this something that changed as in was fine but then went sideways or is this an always been this way kind of thing?

Hi,

If project server is working fine, I will suggest to split your Seq may be at least in 2 to 3 parts. Holding around 120+ stages on a single canvas is bit hard and you may land up with such problems.

Regards.

Ah, yes, Apologies. Force of habit I'm afraid

Yes, every developer is suffering at the moment. I have requested that we keep the JS to a maximum of 10 jobs and we will just have to break the functional rule.

It does seem a little bizarre though. I have never experienced this elsewhere.

Hopefully you've involved support in this, yes?

Sequences are compiled differently than regular DataStage jobs, with some of the effort actually occurring on the client. Perhaps a faster connection between client and engine would help you.

Again, how does your compile time compare to a client that is "right next door" (on the network) to your DataStage server?

I thought practically all of a Sequence job's compilation 'effort' happened on the client.

chulett wrote:I thought practically all of a Sequence job's compilation 'effort' happened on the client.

Yes, but all of the objects to be compiled have to be transferred from the engine, and various resulting objects need to be transferred back to the engine. A slow network plays havoc with compilation time.

I'll have to find out where the machine is! We dont seem to have any other network issues though.