Hi thanks for ur quick response...
but still i have one doubt that ..in that scenario if u have duplicate records it will work..as u explained in the example what happens to first record itself..the condition will not satisfy..right....for the second record it is ok...
please clarify me ....
thanks
How to Select distinct records from Files
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 8
- Joined: Sat Jun 25, 2005 8:03 am
- Location: bangalore
-
- Participant
- Posts: 37
- Joined: Sun Aug 01, 2004 1:18 am
Re: How to Select distinct records from Files
You can do it by using Hash stage or.. by loading into any database stage and then select distince.anil kumar wrote:Hi thanks for ur quick response...
but still i have one doubt that ..in that scenario if u have duplicate records it will work..as u explained in the example what happens to first record itself..the condition will not satisfy..right....for the second record it is ok...
please clarify me ....
thanks
Is it make sence...Let me know, if you have any questions
Thanks,
Cnu
We work together to workout...
Cnu
We work together to workout...
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Re: How to Select distinct records from Files
Anil,
When you define the Stage variables assign them an initial value which wont appear in the input data
Yamini
When you define the Stage variables assign them an initial value which wont appear in the input data
Yamini
-
- Participant
- Posts: 8
- Joined: Sat Jun 25, 2005 8:03 am
- Location: bangalore
Re: How to Select distinct records from Files
thank you very much...
it is working fine.
it is working fine.
Use Sort Stg or command and then place stage variable
I agree with this logic that Stage variable can be used to remove the duplicate files but stage variable stores the previous field value. so its better to have sort the data and club the duplicate recs together and then use the stage variable concept.