BuilOP

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
praj
Participant
Posts: 14
Joined: Sat Dec 20, 2003 12:46 am

BuilOP

Post by praj »

I have a buildop doing certain caluculation on an input with aprox 5-6 million od data. In my buildop i am running a loop with 1500 iterations, for each input record. The time this job takes is quiet high. Is there any way of reducing this time? any optimization suggested while working with buildops?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The obvious one is to research smarter algorithms. For example if your 1500 iterations per row processed is to determine whether something exists in an array, contemplate more efficiently searched data structures.
Even exiting the loop as soon as something has been found, rather than completing all 1500 iterations, might be feasible as an improvement. I'm sure there is a cleverer way to do what your job is doing.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Post enough of the code so we can see how it works.
Mamu Kim
Post Reply