Balance I/O load

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
PhaniKonagalla
Participant
Posts: 7
Joined: Tue Jul 28, 2009 6:09 am
Location: Chennai

Balance I/O load

Post by PhaniKonagalla »

Hi.. Can any body give the detailed explanation on the techniques used to balance I/O load in DS parallel jobs?
Phani Kumar
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I'm not sure what your question is without a specific example of a problem you are facing. What is the job design, the number of records, and the time it takes?

One thing you can start with is adding the APT_RECORD_COUNTS environment variable to your job (set it to True), compile, run, and examine the new job log details that the setting adds. This can help you identify the balance of records across partitions.
Choose a job you love, and you will never have to work a day in your life. - Confucius
Post Reply