Page 1 of 1

Identify Unique and Non_Unique Records...

Posted: Wed Apr 06, 2011 11:54 pm
by praburaj
Hi,

My source is a file. I have one column name like ENAME and data's are like below.
ENAME
1
1
2
3.
Now, my problem is I need to capture all the unique records in one file. The records not unique need to capture in other files. I know only If any duplicate records are there, I will capture that records and store it in seperate file. This logic I don't have idea how to implement this. Please any help is really appreciated.

Output:

Uniq_File1 NotUniq_File2
2 1
3 1

Re: Identify Unique and Non_Unique Records...

Posted: Thu Apr 07, 2011 12:07 am
by ds@tcs
First sort the data
then use aggregator and perform group count, then use filterstage and send the records which contains count >1 to alink and count=1 to another link

try this

Re: Identify Unique and Non_Unique Records...

Posted: Thu Apr 07, 2011 12:18 am
by praburaj
Thanks ds. Really your input helped me a lot. I fixed my problem. Thx once again