performance query
Posted: Thu Jun 05, 2008 7:47 am
Hi,
I have a job where i extract about 50 million records from a table.
I join the records with another table which also has around 40 million records on key "A". Later i split these records based on a conditions into 3 links.
Again i have to join these three links (each individually) with a table with Key "B". Since i thought that sort would take more scracth space and the need of repartitioning based on Key B(as initially the records would be partitioned based on Key A), i made the whole job as sequential.
Can anyone suggest me a better way of dealing this. I am worried as the data i am handling is huge.
Thanks!
I have a job where i extract about 50 million records from a table.
I join the records with another table which also has around 40 million records on key "A". Later i split these records based on a conditions into 3 links.
Again i have to join these three links (each individually) with a table with Key "B". Since i thought that sort would take more scracth space and the need of repartitioning based on Key B(as initially the records would be partitioned based on Key A), i made the whole job as sequential.
Can anyone suggest me a better way of dealing this. I am worried as the data i am handling is huge.
Thanks!