32 mil Records

[kkumardatastage]

Input(32 MIL records) Please can any one help me in designing a job that get the following output.
- in input the qsMatchSetID show you the group of records by giving a value i.e 1,2,3,4 if SetID got same Number like 1 then this all 1 should be consider as a group so
Consider the input got 3 rows as a group
Input
MP
DA
DA
THEN Output should be in following format
MP DA
MP DA
DA DA

Input Data:

CONT_ID|qsMatchType|qsMatchSetID
1234|MP|1
2345|DA|1
3421|DA|1
3243|MP|2
5155|DA|2
3515|DA|2
6724|DA|2
9695|MP|3
5693|DA|3
9984|MP|4
6974|DA|4
9590|DA|4
5513|DA|4

output should be in this format

CONT_ID|qsMatchType|qsMatchSetID|CONT_ID_1|qsMatchType_1
1234|MP|1|2345|DA
1234|MP|1|3421|DA
2345|DA|1|3421|DA
3243|MP|2|5155|DA
3243|MP|2|3515|DA
3243|MP|2|6724|DA
5155|DA|2|3515|DA
5155|DA|2|6724|DA
3515|DA|2|6724|DA
9695|MP|3|5693|DA
9984|MP|4|6974|DA
9984|MP|4|9590|DA
9984|MP|4|5513|DA
6974|DA|4|9590|DA
6974|DA|4|5513|DA
9590|DA|4|5513|DA

Thanks
k

[vinothkumar]

Take MP and DA data in 2 different links and join based on qsMatchSetID.

[kkumardatastage]

Take MP and DA data in 2 different links and join based on qsMatchSetID.

Hi
i have done the same thing but i got the following output and i am missing linkages please help me

right now i got the following Output format
MP DA
MP DA


BUT I NEED TO GET THE ACTUAL OUTPUT WITH FOLLOWING FORMAT
MP DA
MP DA
DA DA

Thanks
k

[vinothkumar]

Take all DA in one link and use removeDups to keep the first row only in each qsMatchSetID. One link will have first DA row in each qsMatchSetID. Ohter link will have remaining DA rows. Do join opeartion..

[ray.wurlod]

Search DSXchange for "vertical pivot", because this is precisely what you have specified. However, what you have specified does not appear to me to be a particularly meaningful exercise as stated - are you also carrying through the original key from the source.