Hi all
I have different sources like SQL server table ,.CSV files and my target is SQL server.
Stage which i am using is ODBC stage.
While loading taget table is taking 28 rows/per second (i have to load 5 laks recods) it taking arround 5 hr to load.
Please suggest me Is any way is there to improve the performance.
Regards,
Ramu
performance Isuue
Moderators: chulett, rschirm, roy
performance Isuue
MOHAN
The first step is always to figure out which component is slowing the overall process down, i.e. which one is the "bottleneck".
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
That doesn't help narrow down the bottleneck. Replace the final hashed file stage with a sequential file that is located on /dev/null and re-run. Is the speed still around 28/rows per second? If yes, then you now know that the hashed file isn't slowing your job down.mohandl wrote:While loading from Hash file to Sql server table it is taking 28 rows/sec
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Describe fully how you are loading SQL Server. Are you using insert-only, update-only, or one of the combinations. Are you using parameter arrays? How many rows are you sending per transaction? All these settings will affect how efficiently DataStage (ODBC stage) can communicate data into a SQL Server table.
It is no less important, however, to eliminate other possible bottlenecks from your consideration. So please describe your job design fully - what stage types you are using throughout, and how they are connected.
It is no less important, however, to eliminate other possible bottlenecks from your consideration. So please describe your job design fully - what stage types you are using throughout, and how they are connected.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.