Suppose I wished to have same functionality of Remove Duplicates stage, but also have deduped records go to a reject port.
I have read many solutions in achieving this with transformer stage.
I prefer to have an inteface that would have the user specify a key and options to keep first or last instance of duplicate. Is this achievable through a buildop?
From reading the documentation on buildops, it looks as though you can pass column name as a parameters. Do buildops have the ability to access the previous record as you could with transform macros?
Thanks.
BuildOp Questions
Moderators: chulett, rschirm, roy
Have you turn off the auto write / read option in the output / input ? You may have to define the way of reading / writing record by yourself. For example,
In the pre-loop logic:
In the per-loop logic :
Let's have a try ...
In the pre-loop logic:
Code: Select all
init the key
init the temp variable
Code: Select all
check the key
if key break
write record
read record