Merge Stage
Posted: Fri Mar 23, 2007 10:20 am
Merge issue
My requirement is .
1. File1 and File2
2. ID is key field in both File1(ID,Name) and File 2(ID,Designation)
3. Join File1 and File2 base on the ID field
4. Get File3 with this column(ID,Name,Designation) with ID as key field
I have followed this
MergeStage------->Output seqfile
1. First a Merge Stage where I defined the File1 and File2
2. Output seqfile
Issue i am having
DS Tells to define all the column in File1 and File2 in Output seq file File3. I have tried it this way and it worked but now my output is redundant with one extra ID column. The output File 3 look like this(File1.ID,File2.ID,Name,Designation)
Is there any way i can remove one of the ID column with my approach. I don't want want to write into another seqfile.
My requirement is .
1. File1 and File2
2. ID is key field in both File1(ID,Name) and File 2(ID,Designation)
3. Join File1 and File2 base on the ID field
4. Get File3 with this column(ID,Name,Designation) with ID as key field
I have followed this
MergeStage------->Output seqfile
1. First a Merge Stage where I defined the File1 and File2
2. Output seqfile
Issue i am having
DS Tells to define all the column in File1 and File2 in Output seq file File3. I have tried it this way and it worked but now my output is redundant with one extra ID column. The output File 3 look like this(File1.ID,File2.ID,Name,Designation)
Is there any way i can remove one of the ID column with my approach. I don't want want to write into another seqfile.