I want to merge 2 inputfiles into one

bollinenik · Post by **bollinenik** » Wed Nov 29, 2006 3:38 am

bollinenik · Post by **bollinenik** » Wed Nov 29, 2006 4:08 am

I am asking how to merge 2 files in that proper way into single file in Data stage parallel jobs

Sreedhar · Post by **Sreedhar** » Wed Nov 29, 2006 4:35 am

In Unix we have some thing called as file descriptor.
with that we can achieve your requirement.

exec 3<firstInputfile
exec 4<secondInputfile

while not EOF
do

read <&3 Var1
read <&4 Var2

echo Var1 >> Resultant File
echo Var2 >> Resultant File

done

recently we have come across this situation and achieved by this way.

So this should help you

Do look out for File descriptor

Nageshsunkoji · Post by **Nageshsunkoji** » Wed Nov 29, 2006 5:01 am

bollinenik · Post by **bollinenik** » Wed Nov 29, 2006 5:01 am

Is there any way in data stage

bollinenik · Post by **bollinenik** » Wed Nov 29, 2006 5:15 am

Thx nagesh,

Funnel will work if both the files will have same metadata here 2 input files metadata is different but key fields are same
In that way funnel won't work right.....So if you hane any other idea in this way pls let me know

caltog · Post by **caltog** » Wed Nov 29, 2006 6:06 am

Why you do not format both file with same metadata just before the funnel stage, with a transformer for example ?

bollinenik · Post by **bollinenik** » Wed Nov 29, 2006 7:43 am

Thx Caltog,

I did in that way but how i can define linkordering the firstfile record should be first in outputfile and the record from 2nd file should be 2nd in the sorting is there any way

ray.wurlod · Post by **ray.wurlod** » Wed Nov 29, 2006 2:11 pm

The easiest way is to preprocess the files so that they each have two additional columns, the file indicator and the row number (both of these can be generated by the Sequential file stage using optional properties).
Sort on these.
You can drop those columns prior to your final write.

chandra · Post by **chandra** » Fri Dec 01, 2006 1:24 pm

Correct me if Im wrong !

Merge :-
I see there are four fileds in one file and 5 fields in other file .

and output required is 5 fields o/p.
ClaimNo1|Version1|?||XX|xxxxxxx
ClaimNo1|Version1|itemno1|XX|xxxxxxx
ClaimNo2|Version1|?||XX|xxxxxxx
ClaimNo2|Version1|itemno1|XX|xxxxxxx

Q 1:- can we subistitue the Question mark ..
if so u try with funnel.

DSguru2B · Post by **DSguru2B** » Fri Dec 01, 2006 1:33 pm

Is that your final output or you will be needing to use this file for further processing. If yes for further processing then add the extra column in the second file and use a funnel stage to cat both of these files.
If this is your final output then just cat it at the unix level by

Code: Select all

cat file1 file2 > file3

ray.wurlod · Post by **ray.wurlod** » Fri Dec 01, 2006 3:01 pm

If you MUST use DataStage, use a Funnel stage and a Sort stage.