Number of jobs running

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Number of jobs running

Post by nagarjuna »

Hello All ,

I am working on a cluster environment . We have 4 servers . Server1 is the conductor node ( 8.5 engine & WAS are installed ) .Server2 , Server3 , Server4 have engine installed . There are some projects deployed in server1 , server2 , server3 , server4 . I want to know at any given point what are all the jobs running on all the servers .

Is it not sufficient to execute ps -aef | grep DSD.RUN on server1 ( which hosts WAS & Engine ) to find all the jobs running on all the servers ?

Thanks
Nag
Nag
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

"Is it not sufficient to execute ps -aef | grep DSD.RUN on server1 ( which hosts WAS & Engine ) to find all the jobs running on all the servers ? "

We can't answer that for you.

You could obtain a list of all of the jobs for each project. You could parse out your PS connad to find the job name, then compare it to your list of jobs/project. It's not the best approach, but you could get a crude way of listing "who's on".
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Based on your description, you have multiple engine installations registered with the Services tier (WAS), and projects are deployed on engines.

Running the command line you provided on server1 will only show jobs which were submitted by the engine tier on server1. I believe you will need to run the command on each of the engine tiers to see the jobs running on all servers.

Regards,
- james wiles


All generalizations are false, including this one - Mark Twain.
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

Thanks james for your response .

So , suppose there is a project on engine2 ( server2 ) & there are 2 jobs running in that project . Do you mean to say that we won't be able to see those two job processes on Server1 ( WAS , conductor node ) ??
Nag
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Unless I have either misunderstood your description, or if you have incorrectly described the architecture of your installation to me, you have four separate engine installations, each with their own set of projects.

In your example, engine 2 owns the project in which the two jobs exist and are running. The DSD.RUN processes will execute on that server--they are DS Server processes--in this case server2. You will not see those on any of the other engine servers.
- james wiles


All generalizations are false, including this one - Mark Twain.
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

Appreciate your inputs James .Till now , I thought that when ever we are running a job on any engine, The DSD.RUN process will show up on server where WAS & Engine are installed . Thanks once again for clarifying
Nag
jwiles
Premium Member
Premium Member
Posts: 1274
Joined: Sun Nov 14, 2004 8:50 pm
Contact:

Post by jwiles »

Keep in mind that my answer is based upon the topology you have described: separate engine installations (that is you physically ran the installer on each server to install the engine tier, not just copied the engine binaries from another server), each engine individually registered to WAS and each housing a separate set of projects. The engine/server which owns the project is the one on which the DSD.RUN processes will be seen for jobs within that project.

Regards,
- james wiles


All generalizations are false, including this one - Mark Twain.
nagarjuna
Premium Member
Premium Member
Posts: 533
Joined: Fri Jun 27, 2008 9:11 pm
Location: Chicago

Post by nagarjuna »

Got it :)
Nag
Post Reply