DSXchange

Hi all,

Funnel stage does union operation corresponding to the input and the output link or it does union all operation?

I want to remove duplicates as well, so i have doubt whether i have to use remove duplicates stage or not after that.

Thanks in advance.

dsscholar wrote: I want to remove duplicates as well, so i have doubt whether i have to use remove duplicates stage or not after that.

Yes.

Funnel puts all rows from all inputs onto its single output. That's a UNION ALL. There is no capacity within the Funnel stage to remove duplicates. Remember, one task, one stage type.