Page 1 of 1

Unable to capture reject records while reading file with RCP

Posted: Tue Jul 08, 2008 10:38 am
by r.bhatia
Hi All,

I have a generic extract job which uses RCP with the following design

seq_stage ---> filter_stage --> data_set

The seq_stage reads an ebcdic file using schema file

The problem with this job design is that even when the file is invalid (not in expected format as specified in schema file) the job creates the corresponding dataset with improper data.

I tried to introduce a reject link from seq_stage so that the records with improper data are rejected.

But I am getting the following warning:

isf_source: Record format type=implicit: cannot save rejected records.

And no reords are being rejected. I want to introduce record/row level
error handling in this genric job. Any suggestions on this?

Posted: Tue Jul 08, 2008 3:22 pm
by ray.wurlod
Diable RCP in the Sequential File stage.

Posted: Tue Jul 08, 2008 5:46 pm
by John Smith
In your sequential file stage with RCP turned ON, you should still include at least one or more defined columns e.g the first column of your file. If you can do that then you can get the reject records.
If not then you will need to validate the files before reading them in the job.

8.5 changes are interesting

Posted: Tue Sep 06, 2011 9:08 am
by rachit82
I got the same issue. check if you have selected the multi-node option and the report progress option. apparently these options coupled with the reject option for data cause the warnings. As far as i've seen, no solution is available but if i find something, i'll let you know.