Issue with link count in Modify stage
Moderators: chulett, rschirm, roy
Issue with link count in Modify stage
Hi,
The modify stage is used to format the rejects from odbc stage and capture the records in a flat file. After execution of the job, when looked at the monitor to view the no. of records in each link, the primary and output links for the modify stage shows as 0 though the records are present in both the links. This scenario happens when the execution mode of the modify stage is "Parallel", also the status is shown as "unknown".
When the execution mode is changed in the modify stage to "Sequential" then the link shows the count and status is "Finished". Simlarly when the primary link is normal link the count is displayed regardless of the execution mode.
The problem occurs when the source link is a reject link.
Any thoughts on this?
Thanks in advance.
The modify stage is used to format the rejects from odbc stage and capture the records in a flat file. After execution of the job, when looked at the monitor to view the no. of records in each link, the primary and output links for the modify stage shows as 0 though the records are present in both the links. This scenario happens when the execution mode of the modify stage is "Parallel", also the status is shown as "unknown".
When the execution mode is changed in the modify stage to "Sequential" then the link shows the count and status is "Finished". Simlarly when the primary link is normal link the count is displayed regardless of the execution mode.
The problem occurs when the source link is a reject link.
Any thoughts on this?
Thanks in advance.
-
- Participant
- Posts: 57
- Joined: Wed Oct 21, 2009 4:46 am
- Location: India
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
You can sometimes see the same thing with the Copy stage. The answer is in the score - the stage is actually taken out by the optimizer. In the case of a Modify stage, it can be made a property of the input link of its downstream stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Thanks Ray.
Actually we are capturing the rowcount and the link names and display the stats on a front end. Though there are records from the link, it shows as 0 (for input & output link) in the modify stage which is incorrect.
Basically we are dropping few columns and capturing the reject records.
Processing is done with two nodes and xml also shows rowcount as 0.
Any suggestions on getting the correct rowcount please
Actually we are capturing the rowcount and the link names and display the stats on a front end. Though there are records from the link, it shows as 0 (for input & output link) in the modify stage which is incorrect.
Basically we are dropping few columns and capturing the reject records.
Processing is done with two nodes and xml also shows rowcount as 0.
Any suggestions on getting the correct rowcount please
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Examine the score. Satisfy yourself that there is no Modify stage (operator). Try using the stage on the other end of the link as the stage name argument to DSGetLinkInfo().
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.