funnel stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dsscholar
Premium Member
Premium Member
Posts: 195
Joined: Thu Oct 19, 2006 2:45 pm

funnel stage

Post by dsscholar »

Hi all,

Funnel stage does union operation corresponding to the input and the output link or it does union all operation?

I want to remove duplicates as well, so i have doubt whether i have to use remove duplicates stage or not after that.

Thanks in advance.
BI-RMA
Premium Member
Premium Member
Posts: 463
Joined: Sun Nov 01, 2009 3:55 pm
Location: Hamburg

Re: funnel stage

Post by BI-RMA »

dsscholar wrote: I want to remove duplicates as well, so i have doubt whether i have to use remove duplicates stage or not after that.
Yes.
"It is not the lucky ones are grateful.
There are the grateful those are happy." Francis Bacon
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Funnel puts all rows from all inputs onto its single output. That's a UNION ALL. There is no capacity within the Funnel stage to remove duplicates. Remember, one task, one stage type.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply