Iam trying to do the implementation of Pivot with the help of Sort stage.
Code: Select all
EmployeeID ArchiveID Empno FieldName DataValue Version DateCreated
11 81 111 First_name RAM 1 2013-05-31 05:33:32.710
22 92 111 First_name RAM 1 2013-04-16 10:06:32.710
33 71 111 First_name RAM 1 2013-05-31 07:40:51.663
Code: Select all
Empno first_name Emp__id archive_id Version DateCreated
111 RAM 11 81 1 2013-05-31 05:33:32.710
111 RAM 11 92 1 2013-04-16 10:06:32.710
111 RAM 33 71 1 2013-05-31 07:40:51.663
My job DataSet -> Sort ->Transformer - >RD -> DataSet
In the sort doing Hash partition by 5 key columns, generating a key change column, sorting keys are all 5 columns.
In Transformer and RD partition is SAME.
Is this approach correct, iam not able to get the correct output.
Any help would be appreciated.
Thanks,