Performance issue

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ashishm
Premium Member
Premium Member
Posts: 37
Joined: Thu Jun 16, 2011 8:12 am
Location: india

Performance issue

Post by ashishm »

We have 2 projects in same server,one for development and another one for testing.One of the job using
sequential file->XMLInput->Transformer->Dataset file

Input sequential file has 40000 XMLs(size nearly 1 gb). Each XML is in a single line We imported this job in both projects (development & testing).In testing project job runs with production time of 3 minutes but the same job in development project runs with production time of 3 hours.

Can anyone suggest any solutions for this issue :?:


Thanks in advance ...
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

Different APT file configuration?
Different level of debuging options turned on at project level?
Different resource disks associated with the projects (see APT file)?
Solar Flares during run #2?
ashishm
Premium Member
Premium Member
Posts: 37
Joined: Thu Jun 16, 2011 8:12 am
Location: india

Performance issue

Post by ashishm »

Hi PaulVL
I checked APT file configuration of both projects.They looked identical.

Any other solutions :?:
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

Make sure it's the exact some job design in both projects, exact same input file, etc... Dump the score from each job and compare differences. Also check in the job log detail when it starts you find all the environment variables. Compare all those differences too.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply