Selecting the option "SORT" in stages like Lookup,

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sudeepmantri
Participant
Posts: 54
Joined: Wed Oct 25, 2006 11:07 pm
Location: Hyderabad

Selecting the option "SORT" in stages like Lookup,

Post by sudeepmantri »

Hi,
I need to fine tune my job in order for a better performance; Wherever I use Lookup, join or merge I am using Hash partitioning with the sort option(No question of changing the HASH as record counts are extremely high 340 million). I just wanna know is the sort necessary in this case. I mean whenever a hask key assigned to a value the keys are stored automatically in the Index table in sorted order right. So it hardly matters if I sort them or not as there are 2 fields in the table which Identify a record uniquely and on both of them I applying the HASH (Both in Master, input and Update, Reference link)....

Suggestions are highly appreciated

Thanks in advance
Sudeep
Last edited by sudeepmantri on Thu Aug 02, 2007 10:41 pm, edited 2 times in total.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Why would you both mark this as and post it in the Server forum?


(waves to Ray)
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply