Hi all,
I have developed a server Job in which i am reading Data from a Oracle Database and then through Transformer puts the DAta Into SAPBW LOAD PACK.
Currently when i increased the Array Size to 2000 the reading speed is 700 records per second. IS there any way i can increase this speed to 7000 records per minute?
Thanks
Ashish
How to increase the Speed of Data read from Oracle Database
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 7
- Joined: Fri Nov 16, 2007 7:18 am
- Location: Pune
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 7
- Joined: Fri Nov 16, 2007 7:18 am
- Location: Pune
ashishpascal - there are too many ways to slow down and speed up jobs to be able to answer your question. First step - know thyself. Is your read or write the bottleneck?
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 7
- Joined: Fri Nov 16, 2007 7:18 am
- Location: Pune
when i tried to read data from Oracle Database and write it to Sequential file , the job took just 10 minutes and when instead of Sequential File i am using SAPBW LOAD PACK (to send the data to SAP BW server) , its taking more than 2.5 Hrs to complete the Job.
This SAPBW LOAD PACK is the Bottle Neck.
Can you just suggest me some way so that i can reduce this 2.5 Hrs to less than an Hour , as i need to bring in this SAP Load Pack into the Job Design and the very function of Load pack is to Reduce the Transfer time.
Thanks
Ashish
This SAPBW LOAD PACK is the Bottle Neck.
Can you just suggest me some way so that i can reduce this 2.5 Hrs to less than an Hour , as i need to bring in this SAP Load Pack into the Job Design and the very function of Load pack is to Reduce the Transfer time.
Thanks
Ashish
JUST BE!
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Compared to what?ashishpascal wrote: the very function of Load pack is to Reduce the Transfer time.
SAP is going to do an immense amount of validation of data being sent into it. DataStage sends data as fast as SAP is prepared to accept them.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.