Hello Folks
I have a requirement to merge 2 files , with precedence to the first file.
I have used a change capture to do this .
File1 is copied and one is put to output and other link is put to change capture, file2 is directly put to change capture . After ChangeCapture data is merged with file1 data and duplicate is removed . Although looks logically ok , iam not getting expected output !
need your expertise on it ..
Using the Change Capture stage
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Participant
- Posts: 3593
- Joined: Thu Jan 23, 2003 5:25 pm
- Location: Australia, Melbourne
- Contact:
To merge the two files you would need to run Change Capture AND Change Apply. Otherwise you would only end up with output from the primary file and nothing from the lookup file. You might be better off with the Merge stage that runs updates from the lookup file against the primary file in one step.
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn:Vincent McBurney LinkedIn
Thanks for your replies
The following was the mistake i had made
The inputs were hash partitioned and sorted , and i was giving the partition to be Auto in the stage
Thanks to you too Vincent , i need data from only one file where keys were same so the "after" link was that , if uniques were present in both they will come out as inserts/deletes from CC stage , so i need not have a change apply in conjunction .
Thanks again , marking this resolved...
The following was the mistake i had made
The inputs were hash partitioned and sorted , and i was giving the partition to be Auto in the stage
Thanks to you too Vincent , i need data from only one file where keys were same so the "after" link was that , if uniques were present in both they will come out as inserts/deletes from CC stage , so i need not have a change apply in conjunction .
Thanks again , marking this resolved...