Hi ,
I am validating a record using lookup stage and if there is a lookup failure i need to reject that record but the rejected record need not be posted to a log(Datastage logs/log files).
I am wondering is there a Do nothing functionality in any of the stages in Datastage 8.1 so that i could use that to stop the flow of the rejected/discarded data..?( I am aware that in a parallel job data lands finally to passive stages/peek stage .. but in my scenario, i shouldn't be using any passive stages to capture that rejected data )
Any clue please ..?
Get count of rejected records without outputting them?
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 247
- Joined: Mon Jan 22, 2007 11:33 pm
-
- Participant
- Posts: 247
- Joined: Mon Jan 22, 2007 11:33 pm
Hi,
The count and the reconcillation stuff happens in a After job subroutine
I would need records to be flowing out of the reject link so that i gets counted by the After job subroutine but rejected records should just get ignored from the rest of the processing( neither stored nor logged any where !)
I believe if i connect copy stage to a reject link and leave it with out a output link (to throw away the data from further processing) then i will get a compilation error( As a pre requisite the copy operator needs an output).
The count and the reconcillation stuff happens in a After job subroutine
I would need records to be flowing out of the reject link so that i gets counted by the After job subroutine but rejected records should just get ignored from the rest of the processing( neither stored nor logged any where !)
I believe if i connect copy stage to a reject link and leave it with out a output link (to throw away the data from further processing) then i will get a compilation error( As a pre requisite the copy operator needs an output).
Regards
Ragu
Ragu
Try it and let us know.Ragunathan Gunasekaran wrote:I believe if i connect copy stage to a reject link and leave it with out a output link (to throw away the data from further processing) then i will get a compilation error( As a pre requisite the copy operator needs an output).
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
-
- Participant
- Posts: 247
- Joined: Mon Jan 22, 2007 11:33 pm
Well said .. The solution should be tried first ....
Copy stage works to throw away data from further processing with ease...I have connected the copy stage to the reject link of the lookup stage and left the copy stage with out any output links
With the above design the job compiled and ran sucessfully maintaining the count on the reject link and discarded data from further processing.... Thanks for the suggestion.
Copy stage works to throw away data from further processing with ease...I have connected the copy stage to the reject link of the lookup stage and left the copy stage with out any output links
With the above design the job compiled and ran sucessfully maintaining the count on the reject link and discarded data from further processing.... Thanks for the suggestion.
Regards
Ragu
Ragu