Server jobs to include Parallelism Conept
Moderators: chulett, rschirm, roy
Server jobs to include Parallelism Conept
Is their any possible way to convert an Datastage Server Job to parallel extender, (ie., to implement the parallelism concept in server jobs).
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Pipeline parallelism is implemented using inter-process row buffering.
Partition parallelism is implemented using either Transformer or Link Partitioner stage to partition the data and Link Collector stage should you need to collect the parallel streams back to a single stream.
In short, in parallel jobs parallelism is automatic and scales without re-design or re-compilation. In server jobs parallelism must be designed in, and therefore can not be scaled differently without re-design.
Partition parallelism is implemented using either Transformer or Link Partitioner stage to partition the data and Link Collector stage should you need to collect the parallel streams back to a single stream.
In short, in parallel jobs parallelism is automatic and scales without re-design or re-compilation. In server jobs parallelism must be designed in, and therefore can not be scaled differently without re-design.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.