Hi,
I would require to join two files and take the result of nonmatching columns in the target.I cannot use lookup as the file is too large and join too as i want to avoid on outer joins.Is there any stage to do this .
What is the problem in using Join stage for large no of data? I hope funnel stage will not help for this. You will try to use join stage or you will use Change Capture stage.
As you notice, rajiivnb had declined the choice to use Hash or Join stage.
You can achieve the same using Funnel stage by adding an extra 'source file id' column and sort the input by key + source_file_id. This will then be useful to work the difference with stage variables.