hi,
In my parallel job one stage (transformer) is sequential. Does it have any negative impact on performance? will it be bottleneck for the complete prallel flow?
Thanks,
Vishal
One stage is sequential in parallel jon
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 39
- Joined: Mon Feb 13, 2012 1:30 pm
-
- Participant
- Posts: 39
- Joined: Mon Feb 13, 2012 1:30 pm
Is the transformer sequential for a certain reason? Does it HAVE to be sequential in order to meet business logic requirements?
Any sequentially operating stage in a parallel job has the potential to be a bottleneck depending upon the job design and data being processed, but that doesn't mean they will be.
Regards,
Any sequentially operating stage in a parallel job has the potential to be a bottleneck depending upon the job design and data being processed, but that doesn't mean they will be.
Regards,
- james wiles
All generalizations are false, including this one - Mark Twain.
All generalizations are false, including this one - Mark Twain.
-
- Participant
- Posts: 39
- Joined: Mon Feb 13, 2012 1:30 pm
I have the following logic to compare the name of two records. Where the file is sorted on name and rownumber, because there can be two groups same name but sandwitched with another group of name. THe below does not work correctly if the stage is parallel
StageVar1 = Input.name
StageVar2 = (if StageVar1 = StageVar3 then StageVar4 else StageVar4 + 1)
StageVar3 = StageVar1
StageVar4 = StageVar2
StageVar1 = Input.name
StageVar2 = (if StageVar1 = StageVar3 then StageVar4 else StageVar4 + 1)
StageVar3 = StageVar1
StageVar4 = StageVar2
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: