remove duplicate

rmeenakumari822 · Post by **rmeenakumari822** » Fri Aug 07, 2009 4:35 am

Hi,

I need to remove duplicate data from the source, only by using transformer stage....Can any one tell me the logic in detail.

Thanks

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Fri Aug 07, 2009 4:37 am

Appears like interview questions. Are they ?

rmeenakumari822 · Post by **rmeenakumari822** » Fri Aug 07, 2009 4:41 am

s can u help me...with logic

ArndW · Post by **ArndW** » Fri Aug 07, 2009 4:55 am

If you tell us what you've tried so far and what has or hasn't worked for you (i.e. convince someone that this is not an interview question) then I'm sure you will get quick assistance. Since someone is going to ask anyway, I will - why must you use only a transform stage? Unless there is a very good reason then one should use a built-in stage, the one that comes to mind is the "remove duplicates stage".

priyadarshikunal · Post by **priyadarshikunal** » Fri Aug 07, 2009 5:19 am

rmeenakumari822 wrote:s can u help me...with logic

I don't know any one called "S" on DSXchange. Hence 'S' will not be able to suggest whether "U" can help you or not.

ray.wurlod · Post by **ray.wurlod** » Fri Aug 07, 2009 5:34 am

Would you use a crowbar to fasten a rivet? Use the correct tool for the job. In this case the correct tool is either the Remove Duplicates stage or the unique option in a sort.