Page 1 of 1

Reference Match Stage aborting

Posted: Wed Apr 20, 2011 3:57 am
by mdbatra
Hi,
I am running a job with Reference Match stage. I am able to test my Pass in the Match specification and the job as well was running fine.

Now suddenly the job is getting aborted because of the below warning/error.

Warning: "rmDelivryOffcAndOrgName,0: Maximum # relabelling loops exceed limit (1000)"
Error: rmDelivryOffcAndOrgName,0: Fatal Error: isUsable() is false on the accessor interfacing to field "Org_Extension".

"Org_Extension" is the column used for blocking. Is it because of the reason that this attribute contains very few distinct values resulting in less no. of blocks and hence overflowing or something ? Not sure.

The job has been running good for a volume of 10,000 records earlier. This time, even the volume is also lesser ( ~ 3,000).

Would appreciate any guidance on this.

Posted: Wed Apr 20, 2011 4:22 am
by ray.wurlod
Sounds like a severe case of block overflow (check the Director log for messages about this). Can you add one or two more blocking fields?

Posted: Wed Apr 20, 2011 6:33 pm
by stuartjvnorton
You ideally want a large number of small blocks.
Block too loosley and you're going to be comparing apples vs oranges, just because they're both fruit. :wink:

Posted: Wed Apr 20, 2011 6:34 pm
by stuartjvnorton
You ideally want a large number of small blocks.
Block too loosley and you're going to be comparing apples vs oranges, just because they're both fruit. :wink:

Posted: Fri Apr 22, 2011 9:22 am
by mdbatra
The job is running fine on its own again :)
But, to be on safer side, i have added extra blocking columns.

One more thing, do we have any way to parameterize the Match specifications in the Reference match stage or something like that to provision Match specifications at Run Time.

Posted: Fri Apr 22, 2011 2:47 pm
by ray.wurlod
There's no scope for parameters in the Match Specification itself. Nor, as far as I can tell, can you use a parameter for the Match Specification in a Reference Match stage or an Unduplicate Match stage. Why would you want to?

Posted: Sat Apr 23, 2011 8:54 am
by mdbatra
Fine :) Thanks very much.