Copy Stage
Posted: Sat Jul 19, 2008 5:40 pm
I've read in a number of places that the copy stage is compiled out if the Force option is set to false but I've just done a simple experiment.
All stages have Combinability Mode set to Auto.
So what am I missing?
Code: Select all
CopyTable1 - From source to target with copy stage
------------------------------------------------------------------
ORACLE--------->COPY------------->DATASET
CopyTable2 - Direct from source to target
-------------------------------------------------
ORACLE---------------------------------------->DATASET
And here are the scores generated
CopyTable1 - direct from source to target with copy stage
---------------------------------------------------------
main_program: This step has 3 datasets:
ds0: {op0[2p] (parallel srcCountries)
eAny=>eCollectAny
op1[2p] (parallel inCntry_outCntry)}
ds1: {op2[2p] (parallel delete data files in delete D:/Projects/Devl/scratch/coyTable1.ds)
>>eCollectAny
op3[1p] (sequential delete descriptor file in delete D:/Projects/Devl/scratch/coyTable1.ds)}
ds2: {op1[2p] (parallel inCntry_outCntry)
=>
D:/Projects/Devl/scratch/coyTable1.ds}
It has 4 operators:
op0[2p] {(parallel srcCountries)
on nodes (
node1[op0,p0]
node2[op0,p1]
)}
op1[2p] {(parallel inCntry_outCntry)
on nodes (
node1[op1,p0]
node2[op1,p1]
)}
op2[2p] {(parallel delete data files in delete D:/Projects/Devl/scratch/coyTable1.ds)
on nodes (
node1[op2,p0]
node2[op2,p1]
)}
op3[1p] {(sequential delete descriptor file in delete D:/Projects/Devl/scratch/coyTable1.ds)
on nodes (
node1[op3,p0]
)}
It runs 7 processes on 2 nodes.
CopyTable2 - direct from source to target
----------------------------------------
main_program: This step has 2 datasets:
ds0: {op1[2p] (parallel delete data files in delete D:/Projects/Devl/scratchcopyTable2.ds)
>>eCollectAny
op2[1p] (sequential delete descriptor file in delete D:/Projects/Devl/scratchcopyTable2.ds)}
ds1: {op0[2p] (parallel srcCountries)
=>
D:/Projects/Devl/scratchcopyTable2.ds}
It has 3 operators:
op0[2p] {(parallel srcCountries)
on nodes (
node1[op0,p0]
node2[op0,p1]
)}
op1[2p] {(parallel delete data files in delete D:/Projects/Devl/scratchcopyTable2.ds)
on nodes (
node1[op1,p0]
node2[op1,p1]
)}
op2[1p] {(sequential delete descriptor file in delete D:/Projects/Devl/scratchcopyTable2.ds)
on nodes (
node1[op2,p0]
)}
It runs 5 processes on 2 nodes.
All stages have Combinability Mode set to Auto.
So what am I missing?