Page 1 of 1

remove duplicate

Posted: Fri Aug 07, 2009 4:35 am
by rmeenakumari822
Hi,

I need to remove duplicate data from the source, only by using transformer stage....Can any one tell me the logic in detail.

Thanks

Posted: Fri Aug 07, 2009 4:37 am
by Sainath.Srinivasan
Appears like interview questions. Are they ?

Posted: Fri Aug 07, 2009 4:41 am
by rmeenakumari822
s can u help me...with logic

Posted: Fri Aug 07, 2009 4:55 am
by ArndW
If you tell us what you've tried so far and what has or hasn't worked for you (i.e. convince someone that this is not an interview question) then I'm sure you will get quick assistance. Since someone is going to ask anyway, I will - why must you use only a transform stage? Unless there is a very good reason then one should use a built-in stage, the one that comes to mind is the "remove duplicates stage".

Posted: Fri Aug 07, 2009 5:19 am
by priyadarshikunal
rmeenakumari822 wrote:s can u help me...with logic
I don't know any one called "S" on DSXchange. Hence 'S' will not be able to suggest whether "U" can help you or not.

Posted: Fri Aug 07, 2009 5:34 am
by ray.wurlod
Would you use a crowbar to fasten a rivet? Use the correct tool for the job. In this case the correct tool is either the Remove Duplicates stage or the unique option in a sort.