Generic file compare using RCP

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
anu123
Premium Member
Premium Member
Posts: 143
Joined: Sun Feb 05, 2006 1:05 pm
Location: Columbus, OH, USA

Generic file compare using RCP

Post by anu123 »

I have a job which does compare two input files and produces output reports. My design is inputfile1 and inputfile2 feed into a difference/cdc stage and based on the diff/change code, I route the records to respective report.

This is working fine for us. I want to make this more generic so that I can use the same job for any file with any metadata. Can this be done using RCP?


Thanks in advance.
Anu
Thank you,
Anu
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

:idea: Split from this 7 year old semi-related post. Please just start your own topic next time for things like this.
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Yes, but only if your comparison basis is "all fields are key"
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
anu123
Premium Member
Premium Member
Posts: 143
Joined: Sun Feb 05, 2006 1:05 pm
Location: Columbus, OH, USA

Post by anu123 »

Thanks Ray.

I have tried that and in that case for example
One out of 100 columns is not matching that
Row will end up in mismatch report

So validatiob team need to spend lot tine
again To verify which out o 100 columns is not matching
Thank you,
Anu
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You can't have both.
If you want DataStage to compare specific columns, you have to name those columns (at least) and that, in turn, limits or rules out the use of RCP.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
anu123
Premium Member
Premium Member
Posts: 143
Joined: Sun Feb 05, 2006 1:05 pm
Location: Columbus, OH, USA

Post by anu123 »

Thank you Ray. I am thinking to have a generic datastage job to compare row to row and then another program ( may be a UNIX script) to further compare at column level.

-Thanks
Thank you,
Anu
Post Reply