Hi Friends,
I am running a server job in which my source is flatfile and target is oracle.
I have tried normal loading and bulk loading in which normal loading is faster than bulk loading.
Is there anyother way where i can increase the speed of loading records and performance also.
Can anyone suggest me please.
Thanks and regards
OPTIMIZATION
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Define "performance" in an ETL context.
Try writing to a text file, and using a customized sqlldr control file to load into Oracle from that. For example, get the buffer sizes right (rather than defaulting to 256 for every field), use parallel load capabilities, and so on.
Try writing to a text file, and using a customized sqlldr control file to load into Oracle from that. For example, get the buffer sizes right (rather than defaulting to 256 for every field), use parallel load capabilities, and so on.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Optimization
ray.wurlod wrote:Define "performance" in an ETL context.
Try writing to a text file, and using a customized sqlldr control file to load into Oracle from that. For example, get the buffer sizes right (rather than d ...
Thanks , I have tried selecting Inprocess and defining some buffer 128 and tried this way, it is bit faster than normal loading.
But is there? any other way which gives lot of difference.
Thanks.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Yes, the way I suggested.
Premium membership is one of the ways that the hosting and bandwidth costs incurred by DSXchange are met. At less than 30c (Rs12) per day, it is definitely a worthwhile investment for anyone claiming to be a DataStage practitioner.
Premium membership is one of the ways that the hosting and bandwidth costs incurred by DSXchange are met. At less than 30c (Rs12) per day, it is definitely a worthwhile investment for anyone claiming to be a DataStage practitioner.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
DIRECT path or CONVENTIONAL? Lots of indexes or none? Triggers? Partitioned table? There are so many factors. Please narrow your question and describe the table and method of load.
Kenneth Bland
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle