Page 1 of 1

Generic file compare using RCP

Posted: Wed Feb 27, 2013 3:34 pm
by anu123
I have a job which does compare two input files and produces output reports. My design is inputfile1 and inputfile2 feed into a difference/cdc stage and based on the diff/change code, I route the records to respective report.

This is working fine for us. I want to make this more generic so that I can use the same job for any file with any metadata. Can this be done using RCP?


Thanks in advance.
Anu

Posted: Wed Feb 27, 2013 3:40 pm
by chulett
:idea: Split from this 7 year old semi-related post. Please just start your own topic next time for things like this.

Posted: Wed Feb 27, 2013 7:42 pm
by ray.wurlod
Yes, but only if your comparison basis is "all fields are key"

Posted: Fri Mar 01, 2013 9:41 am
by anu123
Thanks Ray.

I have tried that and in that case for example
One out of 100 columns is not matching that
Row will end up in mismatch report

So validatiob team need to spend lot tine
again To verify which out o 100 columns is not matching

Posted: Fri Mar 01, 2013 2:44 pm
by ray.wurlod
You can't have both.
If you want DataStage to compare specific columns, you have to name those columns (at least) and that, in turn, limits or rules out the use of RCP.

Posted: Tue Mar 05, 2013 12:45 pm
by anu123
Thank you Ray. I am thinking to have a generic datastage job to compare row to row and then another program ( may be a UNIX script) to further compare at column level.

-Thanks