Page 1 of 1

Copy stage during extraction of data from table

Posted: Tue Jun 03, 2014 9:46 pm
by sharmabhavesh
I am trying to finetune some old Datastage jobs. There are some extraction jobs where we are extracting data from a table (using oracle connector) and putting the data into a dataset. Now in all the jobs I am seeing, a copy stage has been used in between the Oracle connector and Dataset. Since no transformation is taking place and we directly need to dump the data, isn't it better to remove any intermediate stage like copy or transformer. Can we directly join Oracle connector stage to dataset or is it a standard to use a copy stage in between?

Posted: Tue Jun 03, 2014 10:08 pm
by ray.wurlod
You can join the Oracle Connector stage directly to the Data Set stage.

A Copy stage that does nothing will be optimized out of the design when the job is run unless you prevent this behaviour (prove this by examining the score).

A Transformer stage will waste a small quantity of resources at run time.