Datastage performance
Posted: Fri Jul 06, 2001 2:53 am
Hi all,
I have a datawarehouse on Oracle 8.1.6 (on Digital Unix) which im loading using Ardent Datastage 4.1 on NT Server 4.0 I do this using the ORAOCI8 Plugin of DS. So my target is always the ORAOCI8 stage. Now heres the problem. If my source too is Oracle ( the same db or any other db, again using OCI) i get a throughput of abt 650 records/sec. This includes some amount of transformation logic in between. If however, if my source happens to be a sequential file, an ODBC source, an FTP Stage or even a hash file, my throughput falls to abt 4 records/sec, the transformation logic remaining same.
Any tips as on how to speed this up? Some server side settings or a different logic for loading?
Thanks in advance,
Regds,
Vivek Pandey
Consultant - Business Intelligence
Sonata Software Ltd.
Bangalore - India
I have a datawarehouse on Oracle 8.1.6 (on Digital Unix) which im loading using Ardent Datastage 4.1 on NT Server 4.0 I do this using the ORAOCI8 Plugin of DS. So my target is always the ORAOCI8 stage. Now heres the problem. If my source too is Oracle ( the same db or any other db, again using OCI) i get a throughput of abt 650 records/sec. This includes some amount of transformation logic in between. If however, if my source happens to be a sequential file, an ODBC source, an FTP Stage or even a hash file, my throughput falls to abt 4 records/sec, the transformation logic remaining same.
Any tips as on how to speed this up? Some server side settings or a different logic for loading?
Thanks in advance,
Regds,
Vivek Pandey
Consultant - Business Intelligence
Sonata Software Ltd.
Bangalore - India