Performance with Datastage 8

sjfearnside · Post by **sjfearnside** » Thu Aug 13, 2009 6:01 am

I was able to improve my performance by changing my API to a connector. The vendor told me the connector is newer and is cleaner code so I tried it and experienced about a 50% increase for inserting data. My test was a sequential file to an API with insert and I recorded the statistics. When I did an insert it was to an empty table, so I then cleared the table and did the same insert using the new ODBC connector stage and there was a ~ 50% performnace increase in inserts. It also depends on the amount of data. The increase was less on smaller amounts of data. Since you are loading 4 mil records you may find an improvement. You can easily setup a test to see if you get similiar results. My environment is IS V8.0.1 and I was inserting to a db2 table. If you are using IS V8.1 I also did some testing and the DB2 connector did even better.