9.1 slow connection times

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
PeteM2
Premium Member
Premium Member
Posts: 44
Joined: Thu Dec 15, 2011 9:17 am
Location: uk

9.1 slow connection times

Post by PeteM2 »

We have migrated from 7.5.2 to 9.1 and have noticed when running jobs from the command line using the DSJOB command to find out the previous status of a job, we are seeing a 3 to 5 minute delay compared to 7.5.2.

I was wondering whether this was due to the different architecture in 9.1 and the fact that prior to connecting to the 'engine' authentication is performed on the service tier first. Whereas on 7.5.2 the connection id directly to the engine.

any ideas on the delay?
thanks
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

There may be a little delay but I don't think it will be 3 to 5 minutes anyways. The start-up timeout is much less than 3 minutes unless overridden. Did you mention the delay per dsjob command or for a script with multiple dsjob operations?

How loaded is your server? Also version 8.0 onwards datastage installation needs more capacity than 7.5.2.

Also try using DOMAIN=NONE and pass engine tier user details (unix user details) instead of service tier user details and see if it reduces the delay time.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Are you using the operations console and workload management at 9.1? That might cause delays between jobs are started and when they actually get executed (in the interim they have the status of "queued"). I've found that my clients seem to be a bit sluggish at 9.1 compared to 8.7, but that execution times are roughly the same.
PeteM2
Premium Member
Premium Member
Posts: 44
Joined: Thu Dec 15, 2011 9:17 am
Location: uk

Post by PeteM2 »

The delay is for one DSJOB operation that is obtaining the job status for the previous run.

We are using the ops console workload management feature but do not see anything queueing up.
thanks
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

I forgot about WLM in 9.1 entirely :(
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

What about the max number of jobs running setting, I am not sure tasks shows as "queued" if that limit is reached, they might just wait until they get a slot.

What is your dsjob.exe syntax?
PeteM2
Premium Member
Premium Member
Posts: 44
Joined: Thu Dec 15, 2011 9:17 am
Location: uk

Post by PeteM2 »

below is the dsjob command

$DSBin/dsjob -authfile $scriptdir/.DSAuthFile.ini -jobinfo PROD jobname
thanks
PeteM2
Premium Member
Premium Member
Posts: 44
Joined: Thu Dec 15, 2011 9:17 am
Location: uk

Post by PeteM2 »

below is the dsjob command

$DSBin/dsjob -authfile $scriptdir/.DSAuthFile.ini -jobinfo PROD jobname
thanks
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

I am at a loss to explain why it takes so long to return that information. Are all your tiers on the same physical machine and how busy is it when you execute the command. If on separate machines, could one of them be at 100% CPU or I/O and thus blocking the command? I've never noticed any delays in just getting the jobinfo (although I've never used the command-line authentication, but I don't quite see how that could be making a difference here).
PeteM2
Premium Member
Premium Member
Posts: 44
Joined: Thu Dec 15, 2011 9:17 am
Location: uk

Post by PeteM2 »

All the tiers are on the same physical machine
thanks
jdinero
Participant
Posts: 18
Joined: Wed Feb 08, 2012 12:24 pm
Location: NJ

Post by jdinero »

I found this on the IBM set, might be related:

http://www-01.ibm.com/support/docview.w ... wg1JR47809
-Jennifer
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Nice find - that might be the cause, we'll see if the OP returns and can confirm their port usage.
Post Reply