DSXchange

In filter stage i am filtering the particular record which has many duplicates.

which gives all the rows,in order to the first row I set row out put only once. instead of getting only one row i am getting all the row.
could any one help me.

Looks like a remove duplicates logic to me. Do you want to remove all the duplicates from the data? Then use a Remove Duplicates stage instead of a filter stage. Hash partition and sort the data on the key fields.

Maveric wrote:Looks like a remove duplicates logic to me. Do you want to remove all the duplicates from the data? Then use a Remove Duplicates stage instead of a filter stage. Hash partition and sort the data on the key fields.

i didn't mean removing the duplicates. i set 'output row once', option in filter stage,and still i didn't notice any change in the output.

will this option allow only one record from the filtered output.

This is what the documentation says: Setting this to true will pass the record only once to any output links.