Posted: Wed Dec 11, 2002 12:02 am
It's very hard to provide generic answers without some knowledge about what you are trying to do. One thing to contemplate is to use Quality Manager to perform an initial audit of data quality so that, even though you can't actually change the database, you can at least get a "scientific" measure of how bad the data quality is.
That said, for the rest the answer is to do things as efficiently as possible. Make as much use as possible of in-line expressions (in Transformer stages, or in Transforms), and use optimally efficient coding techniques when you are forced to create Routines. In the main, this is not doing anything you don't have to do (such as extraneous file opens), using more efficient rather than less efficient BASIC statements, and keeping as much as possible in memory for as long as possible (see COMMON in the BASIC manual for example).
Let me pre-empt your next question. There is no published list of "more efficient rather than less efficient BASIC statements", mainly because what is most efficient will depend to some extent on the context in which it is used.
That said, for the rest the answer is to do things as efficiently as possible. Make as much use as possible of in-line expressions (in Transformer stages, or in Transforms), and use optimally efficient coding techniques when you are forced to create Routines. In the main, this is not doing anything you don't have to do (such as extraneous file opens), using more efficient rather than less efficient BASIC statements, and keeping as much as possible in memory for as long as possible (see COMMON in the BASIC manual for example).
Let me pre-empt your next question. There is no published list of "more efficient rather than less efficient BASIC statements", mainly because what is most efficient will depend to some extent on the context in which it is used.