flags for duplicate records

mani10487 · Post by **mani10487** » Tue May 11, 2010 1:14 am

hi/hello,

how to perform flag values for duplicate records..

for example if i have
empid,sal,city
100,1000,chn
101,2000,hyd
100,3000,pune in i/p stage

i should get

empid,sal,city,flag
100,1000,chn,1
101,2000,hyd,1
100,3000,pune,0

in the output.. can anyone tell me how to do this..

vinsashi · Post by **vinsashi** » Tue May 11, 2010 1:19 am

use sort stage

surajkumar · Post by **surajkumar** » Tue May 11, 2010 1:22 am

use sort stage .set sort stage property --cluster key change Colum is true

chulett · Post by **chulett** » Tue May 11, 2010 6:17 am

surajkumar wrote:use sort stage .set sort stage property --cluster key change Colum is true

This would be the full answer.

Althaf6553 · Post by **Althaf6553** » Tue May 11, 2010 7:41 am

You can also find the find occurances of the record using cluster key change Column like
if cluster key change Column =1 then first occurance