can we compare two CSV files in datastage?

qutesanju · Post by **qutesanju** » Fri Feb 06, 2009 7:32 am

can anybody tell how to compare two CSV files using datastage components i need job design for the same

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Fri Feb 06, 2009 7:35 am

Define 'compare'.

- Row by row
- Size
- by Key
- any other method

qutesanju · Post by **qutesanju** » Fri Feb 06, 2009 7:42 am

where is this somparison option
in transformer itself?

Sainath.Srinivasan wrote:Define 'compare'.

- Row by row
- Size
- by Key
- any other method

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Fri Feb 06, 2009 8:09 am

No. I am asking you on how you want to compare.

Nagaraj · Post by **Nagaraj** » Fri Feb 06, 2009 8:39 am

look at the data and identify the uniquenes and compare on the key column which are present in both the files

RodBarnes · Post by **RodBarnes** » Tue Feb 10, 2009 5:14 pm

Nagaraj wrote:look at the data and identify the uniquenes and compare on the key column which are present in both the files

I understand you want to compare data in two sequential files and determine rows that exist in one with rows in the other by comparing values in a key column or columns in each sequential file. You can do this by reading one sequential file into a hash file and then processing the second sequential file against the hash file checking the key column values.

RodBarnes · Post by **RodBarnes** » Tue Feb 10, 2009 5:15 pm

Nagaraj wrote:look at the data and identify the uniquenes and compare on the key column which are present in both the files

I understand you want to compare data in two sequential files and determine rows that exist in one with rows in the other by comparing values in a key column or columns in each sequential file. You can do this by reading one sequential file into a hash file and then processing the second sequential file against the hash file checking the key column values.