how to make a SOA services with deduplication

eostic · Post by **eostic** » Fri Feb 06, 2009 1:47 pm

JRodriquez was much more elegant in the description than I. Sorry for lacking detail.....still another way to describe this technique is this: you can only have one input stream for your ISD job. It comes from the ISD stage. Split it along the way into two (with, for example, a copy). Send one of those links to a lookup, where you will pick up multiple rows from your ultimate reference file, usually using your blocking factors as keys. The resulting rows from the lookup become your reference input. Send the other link from the earlier split to a path that becomes your primary input to the Ref Match Stage.

Ernie

ascen · Post by **ascen** » Tue Feb 10, 2009 4:40 am

Thanks guys. It's working now.
Now it looks like:

As I understood this is a workaround?
There are not any information in documentation that it must be done in such way.

eostic · Post by **eostic** » Tue Feb 10, 2009 8:32 am

Beauty is in the eyes of the beholder. I'd call this a "lovely" Job. It's a technique. ; )