MSSQL Performance Problem
Posted: Mon Apr 25, 2005 3:14 am
I am trying to write a simple server job to take comma separated files and load them into a table in MSSQL Server.
Unlike ORACLE/SYBASE which have load/BCP stages there doesn't appear to be anything that I can use for MSSQL Server except the ODBC stage. By using this method it took 5 1/2 minutes to load 3012 rows which is obviously not acceptable. There will be many rows and many files to process and I need it to take seconds rather than minutes.
Is there any other way to achieve this ?
The table that the data is being stuffed into has (currently) no indexes/no constraints or triggers. The server has been set up in an optimal manner.
If I load the same data file using MSSQL's DTS function then it takes under 2 seconds.
Unlike ORACLE/SYBASE which have load/BCP stages there doesn't appear to be anything that I can use for MSSQL Server except the ODBC stage. By using this method it took 5 1/2 minutes to load 3012 rows which is obviously not acceptable. There will be many rows and many files to process and I need it to take seconds rather than minutes.
Is there any other way to achieve this ?
The table that the data is being stuffed into has (currently) no indexes/no constraints or triggers. The server has been set up in an optimal manner.
If I load the same data file using MSSQL's DTS function then it takes under 2 seconds.