Parallel lookup best practise
Posted: Sat Jun 07, 2008 8:28 am
Having just had the first cup of enterprise....
We always did server job lookups using hashed files. We found that lookups from ODBC stages seemed to do full table scans - or take much longer.
What is the best practise for lookups in enterprise? We have varying volumes - from less than 100 rows to billing data to financial data to call data records.
I see some of my colleagues use ODBC connectors through a lookup stage, but we have been asked to hit source system tables only once. In addition, some of these tables may still need to be used in server job lookups.
Sooooo, any ideas for best practices for our environment?
We always did server job lookups using hashed files. We found that lookups from ODBC stages seemed to do full table scans - or take much longer.
What is the best practise for lookups in enterprise? We have varying volumes - from less than 100 rows to billing data to financial data to call data records.
I see some of my colleagues use ODBC connectors through a lookup stage, but we have been asked to hit source system tables only once. In addition, some of these tables may still need to be used in server job lookups.
Sooooo, any ideas for best practices for our environment?