What are the various parameters needed for ETL performance
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 30
- Joined: Wed Mar 24, 2004 1:28 am
What are the various parameters needed for ETL performance
What are the various parameters needed for ETL performance
Re: What are the various parameters needed for ETL performan
Hi Vikasvikas gupta wrote:What are the various parameters needed for ETL performance
There are many parameters on which your ETL performance depends. I can list some of them here.
The flexibility of the architecture. It shouldn't be tool dependent.
Which database engine will be used for the transformations?
What happens to ETL developments if the physical address of a server changes or if a database name changes?
How you promote code from development to production.
Complexity of business rules.
Number of dimensions and their nature.
Platform.
There is a long list. I hope it helps u.
Regards
Ashwin
The original question is like asking "What can I do to tune my vehicle" in a car forum and can't really be answered, at least directly.
Reading and writing data takes a long time. Try to read and write and "land" data to disk as few times as possible. This approach (while not always correct) usually works pretty well for a starting point.
Reading and writing data takes a long time. Try to read and write and "land" data to disk as few times as possible. This approach (while not always correct) usually works pretty well for a starting point.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Re: What are the various parameters needed for ETL performan
The first thing you need is some definition of "performance". In ETL the key performance indicator is usually the ability to meet some time window in which access to the databases in question is permissible. Nothing else really matters.vikas gupta wrote:What are the various parameters needed for ETL performance
For example, you may be able to process the same volume of data faster just by throwing more processing nodes at it.
Intelligent design and some awareness of which techniques are more efficient than others. Some knowledge of how the ETL tool interacts with data sources (and what alternatives are available) is also vital.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.