parallel job performance

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
just4u_sharath
Premium Member
Premium Member
Posts: 236
Joined: Sun Apr 01, 2007 7:41 am
Location: Michigan

parallel job performance

Post by just4u_sharath »

In My Job, for a single column i have the option of using either
left,right functions (column is date column)
or type conversions (stringtodate, dateto string).
i can use any of these to populate the date columns. Now my question is
will there be any performance degradation if i use type conversions in place of left and right functions to extract data. How can i check whether my job performance is increased or not. is there any specifc environment variable which indicates the job performance. please reply. Input data is nearly 5million records.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Define "performance" in an ETL context.

Rows/sec is almost totally meaningless as a metric of ETL performance, as I will tell anyone who'll listen.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

And anyone who won't listen as well. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply