Copy stage during extraction of data from table

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sharmabhavesh
Premium Member
Premium Member
Posts: 38
Joined: Tue Jun 19, 2012 11:03 pm
Location: India

Copy stage during extraction of data from table

Post by sharmabhavesh »

I am trying to finetune some old Datastage jobs. There are some extraction jobs where we are extracting data from a table (using oracle connector) and putting the data into a dataset. Now in all the jobs I am seeing, a copy stage has been used in between the Oracle connector and Dataset. Since no transformation is taking place and we directly need to dump the data, isn't it better to remove any intermediate stage like copy or transformer. Can we directly join Oracle connector stage to dataset or is it a standard to use a copy stage in between?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You can join the Oracle Connector stage directly to the Data Set stage.

A Copy stage that does nothing will be optimized out of the design when the job is run unless you prevent this behaviour (prove this by examining the score).

A Transformer stage will waste a small quantity of resources at run time.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply