Function to check duplicate values in record

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
rameshkm
Participant
Posts: 24
Joined: Tue May 06, 2008 6:02 am
Location: chennai
Contact:

Function to check duplicate values in record

Post by rameshkm »

Hi,
I am in need a function to check duplicate values on record in transformer, is there any function available in parallel. please help in thism thanks in advance.
Ramesh Kumar.M
anbu
Premium Member
Premium Member
Posts: 596
Joined: Sat Feb 18, 2006 2:25 am
Location: india

Post by anbu »

Use Create Key Change column option in Sort to find duplicates
You are the creator of your destiny - Swami Vivekananda
ETLJOB
Participant
Posts: 87
Joined: Thu May 01, 2008 1:15 pm
Location: INDIA

Post by ETLJOB »

You may have to define few stage variables and compare previous record value with the current record value based on your key columns. You can have an additional flag variable to mark the duplicate records. Just an idea :idea:
Post Reply