What is the best way to load Huge Volume of History data?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
srini_ramesh
Participant
Posts: 13
Joined: Fri Oct 08, 2004 6:19 am

What is the best way to load Huge Volume of History data?

Post by srini_ramesh »

Hi,
What is the best method to load voluminous data into oracle tables using a parallel job in DS. What stages can i use that would be most helpful in fast loading?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I'd opt for a solution that prepared data files for SQL*Loader, then use that actually to load the Oracle tables.

What volume of data do you consider "huge"?

I note that you are claiming to be running parallel jobs on Windows. Is this really the case?

Finally, please don't post the same question more than once. We aren't paid to be urgent; but we do get around to answering when we can. If you want urgent answers, sign up for 7x24 support, and discover the true (monetary) value of "urgent".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Release 7.5x2 is PX on NT.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I just wanted to check that the OP was across this! :wink:
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply