HI Friends,
In copy stage Properties FORCE=TRUE/FALSE.
True to specify that DataStage should not try to optimize the job by removing the Copy operation.
What is the meaning of OPTIMIZE THE JOB. I am unable to understand this.
Please let me know..
COPY_STAGE
Moderators: chulett, rschirm, roy
-
Devendrudu
- Participant
- Posts: 31
- Joined: Tue May 24, 2011 12:16 am
COPY_STAGE
Devendra,Bangalore,India
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Spend some time learning how parallel jobs are constructed and executed at run time. The Conductor process composes the "score" (another osh script) by combining the generated osh from the job design with information from the current parallel execution configuration file.
During this process, which allocates resources to tasks (operators) a number of "optimizations" (some of which can turn out to be sub-optimal, particularly operator combination which is performed as aggressively as possible, but that's another discussion entirely) are performed.
One of these is to remove any Copy stage that does not do anything - that is, that makes an identical copy of its input - the job design with the Copy stage would work the same way if the Copy stage was not there. The Force option in the Copy stage prevents this from happening, leaving a copy operator in the job stream.
During this process, which allocates resources to tasks (operators) a number of "optimizations" (some of which can turn out to be sub-optimal, particularly operator combination which is performed as aggressively as possible, but that's another discussion entirely) are performed.
One of these is to remove any Copy stage that does not do anything - that is, that makes an identical copy of its input - the job design with the Copy stage would work the same way if the Copy stage was not there. The Force option in the Copy stage prevents this from happening, leaving a copy operator in the job stream.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
copy stage
Copy stage the output is >1 give the property False Else set TRue.