Search found 76 matches

by ajith
Sat May 13, 2006 12:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: rejecting duplicate rows
Replies: 5
Views: 3030

I think your best bet wud be either: 1)Use a hashed file stage or 2) Sort the records in Unix using sort command (before job sub-routine) and then using stage variables in the transformer, reject the duplicate records.The addition of Sort stage will surely slow down your job. HTH Yeah , Thats the w...