hi All,
i am facing some performace issue while loading the data into table at the output stage
I am using below stages to load data
Four Datasets are concatenated using funnel stage late it goes to the transformer stage which invokes a external C routine and loads into table
Is there any bulk loading option in DataStage ODBC stage?
I run the job against 150K records, it took almost 3 hours.
The same job i laoded the output into sequential file completed in mins.
Please suggest..
Performance issue while loading into table
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Thanks to all...ray.wurlod wrote:Prove that the "external C routine" is efficient (not the bottleneck).
How do you define "performance" in an ETL context? ...
Yes i am using an ODBC stage to Insert or update the records coming from the source datasets into sybase database in parallel job.
Since i have 150k records expected to insert into table everyday so its just taking time around 3hrs to complete.
My question is that is there any option in which we can bulk insert or update the records into table.
Please advice..