Rejecting data

[deva]

Hi
I am loading data from flat file to hash file through transformer without any constrain.

My question is I want find the duplicates which are not writtening into hash file. how to move the duplicate data into reject link.

Thanks in advance

[ArndW]

All writes to hashed files are "insert or update", so when writing duplicate records you will never have rejects. You will need to locate duplicates in your job; perhaps by sorting the data on the key and using stage variables in your transform stage.

[chulett]

You would have to read the hashed file first to check for existence and 'reject' any that succeed. You can do this all in one transformer if you don't cache the lookup or use the dreaded 'lock for update' option.

[ray.wurlod]

To find duplicates in the source stream you must check within the Transformer stage (using stage variables). There is no other choice without changing your job design.