I'm back; with no workaround nor solution to my problem.
I think I need to go back and share more on my match specifications in this thread. Hopefully, someone could help me identify the source of my problem.
Here goes.
I have a Reference with columns r1 and r2. This Reference will be matched with a Data consisting of columns d1, d2. The match specification should be blocking by (r1,d1), matching by (r2,d2). This is the original match specification. Let's call it MSpec1. Nothing went wrong with MSpec1. Although the results were far from accurate, the job (let's call it Job1) was
successful.
Next, I standardized columns r2 (in Reference) and d2 (in Data). The Reference now has columns r1, r2, r21, and r22 with r21 and r22 as the output from standardizing column r2. The Data (as expected) now has columns d1, d2, d21, and d22 with columns d21 and d22 is the output of standardizing column d2.
With the above changes, the match specification was also changed to blocking by (r1,d1), matching by (r21,d21)+(r22,d22). Let's call this MSpec2. The job (let's call it Job2) with MSpec2
failed to execute generating the error I mentioned in the first post on this thread.
Next, I tried using back MSpec1. The difference is that I'm using the columns already standardized. So I have r1, r2, r21, r22 in Reference and d1, d2, d21, d22 in Data. As mentioned above, blocking is by (r1,d1) and matching is by (r2,d2). Quite unexpected, this job (let's call it Job3)
also failed and returns the same error as with MSpec2.
I thought for sure that running Job3 won't produce any errors because I'm using the same match specification as Job1. Turns out the mere existence of r21, r22, d21, and d22 was already enough to generate error. Now this is confusing for me. Why is it that including these output of standardize stage would generate the error, even though they aren't included in the match specification?
Now I'm facing a dilemma. Using the original columns only should be successful but the results are terrible. Using the standardized columns should definitely improve the match results but I can't get through the errors. Help?