Sort stage with duplicate values in input

aaikat · Post by **aaikat** » Fri Aug 04, 2006 3:31 am

I have a sequential file as Sort stage input containing data like :

empid
1
2
3
1
2
4
4

Now when I use the Sort stage on this input file with ascending empid (Allow Duplicate=True,all other options default), I get the following output

empid
3
1
1
2
2
4
4

which shows repeating values are sorted but non-repeating value('3') comes in wrong position.

Please explain this behaviour.

balajisr · Post by **balajisr** » Fri Aug 04, 2006 3:42 am

what is your target?

aaikat · Post by **aaikat** » Fri Aug 04, 2006 3:48 am

My target is a data set

balajisr · Post by **balajisr** » Fri Aug 04, 2006 4:05 am

Dataset displays data from more than one partitions and the data is sorted within partitions in dataset.

Write the data to the sequential file and find out if there are any differences.

aaikat · Post by **aaikat** » Fri Aug 04, 2006 4:13 am

yes...It is appearing correctly in sequential file..thanks