Search found 76 matches
- Sat May 13, 2006 12:44 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: rejecting duplicate rows
- Replies: 5
- Views: 3030
I think your best bet wud be either: 1)Use a hashed file stage or 2) Sort the records in Unix using sort command (before job sub-routine) and then using stage variables in the transformer, reject the duplicate records.The addition of Sort stage will surely slow down your job. HTH Yeah , Thats the w...