Rejection of Rows while copying from one file to another

deepa_shenoy · Post by **deepa_shenoy** » Thu Oct 22, 2009 10:04 pm

Hi,

I have two files-Current File and Previous File, present in a job.

In the first run, all the records from the source get copied into the Current File and the Previous File is empty.

Before the second run, I use the ExecSH command to copy the data from Current File to Previous File. While doing this,in every load after the first load, certain records are getting rejected.

Why is this happening?

Thanks in advance.

Deepa

ray.wurlod · Post by **ray.wurlod** » Thu Oct 22, 2009 11:48 pm

Not enough information. Why are they being rejected? Are you capturing the rejects and, if so, can you see any pattern in them? What command are you using to move records from current to previous? Do the current and previous files interact with the source in any way? Which stages are running in parallel and which stages are running in sequential mode?

deepa_shenoy · Post by **deepa_shenoy** » Fri Oct 23, 2009 12:00 am

Hi,

I do not know why they are getting rejected. I did use a Reject link to capture the rejected records. There is no pattern for rejection.

I used the command:

cp /filepath/CurrentFile.txt /filepath/PreviousFile.txt

Regards,
Deepa

ray.wurlod · Post by **ray.wurlod** » Fri Oct 23, 2009 12:42 am

Is your source a file, a database connection, or something else? From which stage did you create the reject link? Can you advise the record schema of your source stage and a couple of example reject records?

deepa_shenoy · Post by **deepa_shenoy** » Fri Oct 23, 2009 12:56 am

Hi,

My source is a Database(RDBMS). It passes a Copy Stage then to Seq File(CurrentFile) and a CDC Stage. From CDC it goes to Target Seq File.
Comparison at the CDC Stage is done with another Seq File (PreviousFile).
Rejects from this file is sent to another Seq File.

Regards,
Deepa