Hi
We have a requirement in which our source system type is being finalized.
Is it better to use flat file as source and retrieve data from there or from oracle directly.
Oracle is on a remote server.
Which one to go for and why
Thanks
WHich one will give better performance...flat file or DB
Moderators: chulett, rschirm, roy
1). If your data source is from any relational DB then source data from DB.
2). If you are expecting data from other than relatioanl DB (eg:UNIX box, Mainframes) then allow that data files to land on to your DS server's staging area.
Don't try to dump your Oracle data into your DS server's staging area for the sake of performance.
2). If you are expecting data from other than relatioanl DB (eg:UNIX box, Mainframes) then allow that data files to land on to your DS server's staging area.
Don't try to dump your Oracle data into your DS server's staging area for the sake of performance.
I am trying to test this using some samle load.
I am using an ODBC stage to pull out 100000 records from a table. I am then populating these records to a Sequential file. In the next job I am using this sequential file as source to populate a dataset.
This job hardly takes any time.
While, when I use the Oracle ODBC as the source and try to populate the dataset, it takes fair amount of time. I have tried changing the array sizes and still sequential file as source is performing better.
I am doing the right kind of tests![Question :?:](./images/smilies/icon_question.gif)
I am using an ODBC stage to pull out 100000 records from a table. I am then populating these records to a Sequential file. In the next job I am using this sequential file as source to populate a dataset.
This job hardly takes any time.
While, when I use the Oracle ODBC as the source and try to populate the dataset, it takes fair amount of time. I have tried changing the array sizes and still sequential file as source is performing better.
I am doing the right kind of tests
![Question :?:](./images/smilies/icon_question.gif)