Hi,
I have a sequential file stage which reads data from a file and propagates it further to the next stage. The problem is that my job fails whenever there's a bad record in the file (like metadata mismatch, different record type in file from the metadata). Is there a way I can reject bad records and let the good records flow to the next stage. I don't want to handle these bad records in next transformer stage, just want to reject these records in the sequential file stage itself (while reading the records).
Rejecting bad records from sequential file
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 37
- Joined: Wed Oct 29, 2014 10:48 pm
- Location: Ohio
If your stage fails when a bad record is read by the sequential file stage, the option 'Reject mode' must be set on 'Fail'.
Just change it to 'Continue' or 'Output' if you want to redirect them to a reject link and your job will process only with the good records.
Just change it to 'Continue' or 'Output' if you want to redirect them to a reject link and your job will process only with the good records.
BI Consultant
DSXConsult
DSXConsult
-
- Premium Member
- Posts: 37
- Joined: Wed Oct 29, 2014 10:48 pm
- Location: Ohio
Hi Thomas,
Thanks for the reply. I do not have access to DS right now so I can't check so just a small question. Can I use the reject property of sequential file stage even when I am using the stage as a source stage. I mean, can there be a reject link while reading from a file or a reject link works while the records are being written into a sequencial file.
Thanks for the reply. I do not have access to DS right now so I can't check so just a small question. Can I use the reject property of sequential file stage even when I am using the stage as a source stage. I mean, can there be a reject link while reading from a file or a reject link works while the records are being written into a sequencial file.
-
- Premium Member
- Posts: 37
- Joined: Wed Oct 29, 2014 10:48 pm
- Location: Ohio