Need information about the sort option in merge stage..

datisaq · Post by **datisaq** » Tue Aug 11, 2009 4:02 am

In merge stage there is an option as "sort order" available, i given that as "ascending" for my input data.I selected the partition mechanism as "Hash" and i didn't enable any link sort option not even used an external sort stage since the sort option avaiable in merge stage.

But when i compiled the code and saw the generated OSH there is no where the "sort" operator is present.

Did the merge operator itself will do the sorting? Or else
We need to explicilty specify some link sort or sort stage for sorting the data?

Kindly clarify this..

chulett · Post by **chulett** » Tue Aug 11, 2009 5:35 am

I believe you are telling it the data is already sorted, not asking it to sort the data.

datisaq · Post by **datisaq** » Tue Aug 11, 2009 6:36 am

No my data is not sorted i thought the option mention over there in merge stage will sort my data.

ray.wurlod · Post by **ray.wurlod** » Tue Aug 11, 2009 4:36 pm

You won't see it in the generated OSH. You will see it in the score.

dganeshm · Post by **dganeshm** » Tue Aug 11, 2009 4:53 pm

ray.wurlod wrote:You won't see it in the generated OSH. You will see it in the score. ...

how do we see the score

ray.wurlod · Post by **ray.wurlod** » Tue Aug 11, 2009 6:18 pm

Dump the score into the job log by including the environment variable APT_DUMP_SCORE into your job as a job parameter and setting it to "True".

datisaq · Post by **datisaq** » Wed Aug 12, 2009 12:55 am

Thanks Ray for the help..
Yes it's inserting the "tsort" operator.