DSXchange

Datastage - You could try routines for joining two files, not too sure abt this option.

Unix level - Definately you could have join statements between 2 files and create the merged file. You could trgger this script from DataStage.

the need is to identify the delta from the source systems. Is there any field (Date etc) which indicates that this record is updated. If yes than you can use the same field for identification., Else you need to compare the whole source records to target and find out which all records are getting upd...

Better use other methods for lookup, hash file would not give u good performance,

You could try creating a table which could be used for look up or can use unix level files based joins.

Better use other methods for lookup, hash file would not give u good performance,

You could try creating a table which could be used for look up or can use unix level files based joins.

the bottleneck is the size of the hashfile itself.

See if you could minimise the size of the hash file. or create 2 small hash files for look up instead of 1. Using of caching would also enhance the performance provided the hash file is small.

might be due to privilages of the dsadm in the unix directory structure.

check that the user (dsadm) should have the access to create the directory structure.