Page 1 of 1

Merge stage in server jobs

Posted: Tue Jun 04, 2013 3:17 am
by vinsashi
Hi,
merging two files ,should i need to specify all columns of files in merge stage.if not specify its showing error after running.

example
file1:
c1|c2|c3|c4|c5|c6
file2:
d1|d2|d3|d4

outputfile:
c1|c2|c3|c4|d1|d2|d3|d4


at merge stage level for first file i didnt specified c5 and c6 at column definition level.if i run job the job got aborting.

at merge level in server jobs should we need to keep all columns if not necessary to next stage also.

thanks
vin...

Posted: Tue Jun 04, 2013 5:31 am
by ray.wurlod
Any time you're working with a sequential file - and this includes the Merge stage - you must mention the entire structure. The term "sequential" implies that you have to read past every byte in the file to get to the next one.