Compare Stage
Moderators: chulett, rschirm, roy
Yes, I am looking into the posts but am finidng nothing that is helping. I am looking through the Parallel Developers Guide and I find it a little confusing.
For eg. I have a file with account_no and name columns which I want to compare against another file which has the same 2 columns.
Do I need to specify a key column and in the output file what should the metadata look like?
Thanks.
For eg. I have a file with account_no and name columns which I want to compare against another file which has the same 2 columns.
Do I need to specify a key column and in the output file what should the metadata look like?
Thanks.
ps
I put together a job wherein I read 2 sequential files and pass them through a Cmpare stage and outputs to a sequntial file.
Input file -1 and 2 (have the same col's)
lname
fname
initial (key)
Output file is defined as such:
first.lname
first.fname
first.initial
second.lname
second.fname
second.initial
I get an error as follows:
In field "first": Expected ";", got: ".", line 45
In field "first": Expected ";", got: ".", line 46
In field "second": Expected ";", got: ".", line 47
In field "second": Expected ";", got: ".", line 48
In field "second": Expected ";", got: ".", line 49
Can someone explain this error, please?
Input file -1 and 2 (have the same col's)
lname
fname
initial (key)
Output file is defined as such:
first.lname
first.fname
first.initial
second.lname
second.fname
second.initial
I get an error as follows:
In field "first": Expected ";", got: ".", line 45
In field "first": Expected ";", got: ".", line 46
In field "second": Expected ";", got: ".", line 47
In field "second": Expected ";", got: ".", line 48
In field "second": Expected ";", got: ".", line 49
Can someone explain this error, please?
ps
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Compare stage only compares columns identified as Key.
Also, you will need a column called diff on the output, to receive the result. The output from a Compare stage consists of three columns, diff, the first input link record as a subrecord, and the other input link record as a subrecord.
The Compare stage expects inputs to be partitioned and sorted on these keys.
Also, you will need a column called diff on the output, to receive the result. The output from a Compare stage consists of three columns, diff, the first input link record as a subrecord, and the other input link record as a subrecord.
The Compare stage expects inputs to be partitioned and sorted on these keys.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 407
- Joined: Mon Jun 27, 2005 8:54 am
- Location: Walker, Michigan
- Contact: