Improve Performance

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
srinivas.g
Participant
Posts: 251
Joined: Mon Jun 09, 2008 5:52 am

Improve Performance

Post by srinivas.g »

Source I am having 600000 records and want to load the all records in to(with out transformations) Target table. Job took 22 minutes.

Pelase suggest how to improve the performance. (Simple load source to target). Already target Table having more then 10 milion records and Primary key constraints but no indexes defined.
Srinu Gadipudi
behrouz
Participant
Posts: 41
Joined: Tue Oct 28, 2008 4:13 am

Post by behrouz »

mybe by increasing your buffer,
Arash.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

With so little to go on... perhaps switch to a bulk load.
-craig

"You can never have too many knives" -- Logan Nine Fingers
priyadarshikunal
Premium Member
Premium Member
Posts: 1735
Joined: Thu Mar 01, 2007 5:44 am
Location: Troy, MI

Post by priyadarshikunal »

chulett wrote:perhaps switch to a bulk load.
Bulk load in parallel?

@srinivas.g

need to know which database and what stage is being used to write to it.
Priyadarshi Kunal

Genius may have its limitations, but stupidity is not thus handicapped. :wink:
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

priyadarshikunal wrote:
chulett wrote:perhaps switch to a bulk load.
Bulk load in parallel?
Sure, why not? Worst case, run it on one node, it may still be faster. There's far too little information in the original post to get better answers, so hopefully they'll pony up what you've asked for and whatever else might be helpful.
-craig

"You can never have too many knives" -- Logan Nine Fingers
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

What database? how many nodes?
srinivas.g
Participant
Posts: 251
Joined: Mon Jun 09, 2008 5:52 am

Post by srinivas.g »

Oracle Database,6 nodes .........
Srinu Gadipudi
Post Reply