Performance Issue in ODBC Enterprise
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
Performance Issue in ODBC Enterprise
Hi,
I am using an ODBC Enterprise in one of my job. I was wondering what might be the most effective value of "Fetch Array Size" so as to increase my job performance?
Or does this effective value is dependent on some factors?
I am using an ODBC Enterprise in one of my job. I was wondering what might be the most effective value of "Fetch Array Size" so as to increase my job performance?
Or does this effective value is dependent on some factors?
Thanx and Regards,
ETL User
ETL User
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
It depends on a number of factors. As a starting value use then experiment.
Code: Select all
Int((network packet size) / (average record size))
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You can't calculate it. It's a given. Your network transmits data in "packets". Talk to your network administrator about the concept. Typically packet size is 1KiB, 2KiB or 4KiB.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
@Ray
The avg. row length of my table is 985KB (kilobytes). So according to your formula it comes out to be less than 1
@PaulVL
No, my question was for ODBC Enterprise only.
On second thoughts what if I keep more rows in the buffer than the default that is defined in a stage ? Will my job abort or it'll hamper my performance??
The avg. row length of my table is 985KB (kilobytes). So according to your formula it comes out to be less than 1
![Exclamation :!:](./images/smilies/icon_exclaim.gif)
@PaulVL
No, my question was for ODBC Enterprise only.
On second thoughts what if I keep more rows in the buffer than the default that is defined in a stage ? Will my job abort or it'll hamper my performance??
Thanx and Regards,
ETL User
ETL User
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Check with your network administrator what the packet size is. Obviously such hugely wide rows will need multi-packet transmission. Don't worry about trying to tune Array Size yet - leave it at 1 (that's still 958KB of network traffic per row!). Work with your network administrator to achieve a better packet size.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 353
- Joined: Mon Jan 17, 2011 5:03 am
- Location: Mumbai, India
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: