Need info regd. Performance Monitoring tolls in PX

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
amitaguptain
Participant
Posts: 12
Joined: Wed Oct 19, 2005 5:29 am

Need info regd. Performance Monitoring tolls in PX

Post by amitaguptain »

Hi,

Do anyone has idea about the performance tools in PX?

and how much virtual memory need to be allocated for the PX project?

Another info is needed about the mount points,i mean how many mount points need to be there for the PX project?

Please post me in case anyone has idea on any of the above points...

Thanks in advance
amie
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I need to post a new version which works well with PX jobs. Maybe soon. I think your first step is to put stats in tables so you can measure how it is now against what you may change it to.

All of this is controlled thru config files. Your mount points should match you config file, one per node.
Mamu Kim
csrazdan
Participant
Posts: 127
Joined: Wed May 12, 2004 6:03 pm
Location: Chicago IL

Post by csrazdan »

Following is the guidelines which we follow for setting up PX environemnt based on UNIX mount points:

1. Engine Mount Point - This is the mount point on this DataStage PX engine will be installed. Typical size of this mount point should be 5GB.

2. Project Mount Point - This is the mount point you should use to create your DataStage proejct. Typical size of this mount point should be between 2 GB to 5GB based on number of job in the project.

3. Node Data Mount Point - This is the mount point on which resource and scratch disk files will be created. The number of Node Data Mount Point will depend upon the degree of parallism you want to have in configuration file. For example, if you configuration file has 2 nodes create 2 node data mount points and likewise. The size of node data mount points will depends on the your application data.

4. Project Data Mount Point - This is the mount point on which your can create project data, for example, input files, target files, dataset definition files, reject file, log files etc. The number and size of Project Data Mount Point depends upon your application and how you want to organize it.

Based on how your application grows you can add space to the mount point which actually requires it.

Hope it helps....
Assume everything I say or do is positive
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

When you get version 8.0 there is a particularly wonderful resource estimator tool.

Never use NFS-mounted disks for scratchdisk, and avoid using NFS-mounted disks for resource "disk" (where Data Set and File Set data files are positioned). Avoid those disks being used for extraction and load for other purposes while those phases are being executed.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply