hi
can any body sugg me how do romoveduplecate in transformar stage useing stage varible
regards
sure
how remove duplicate in transformer
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 11
- Joined: Fri May 29, 2009 9:54 pm
- Location: hyd
2 Stage Variables:
constraint "svDuplicate=0"
Code: Select all
svDuplicate IF In.Key=svLastKey THEN 1 ELSE 0
svLastKey In.Key
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
Or, exactly the same but my preference would be:
Constraint "Not(svDuplicate)"
Code: Select all
svDuplicate In.Key=svLastKey
svLastKey In.Key
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Craig, I agree with you - I would program it that way but expanded the logic to make the statement more understandable.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
You can use the following logic to remove duplicates using the Transformer Stage, however for that you need to have data sorted.
Before using the transformer Stage, use Sort Stage to sort the data.
In Transformer Stage, take the
FirstRecordVar=SecondRecordVar
IncomingLnk.Value=FirstRecordVar
Then in constraint you can put constraint like
FirstRecordVar<>SecondRecordVar
This will ensure that duplicates records are not passed to the next stage.
Hope this helps !
Before using the transformer Stage, use Sort Stage to sort the data.
In Transformer Stage, take the
FirstRecordVar=SecondRecordVar
IncomingLnk.Value=FirstRecordVar
Then in constraint you can put constraint like
FirstRecordVar<>SecondRecordVar
This will ensure that duplicates records are not passed to the next stage.
Hope this helps !
-----------------------------------
Regards
MK
What would you attempt to do if you knew you could not fail?
-----------------------------------
Regards
MK
What would you attempt to do if you knew you could not fail?
-----------------------------------
Of course and I figured as much... just couldn't resist the perfect setup.ArndW wrote:Craig, I agree with you - I would program it that way but expanded the logic to make the statement more understandable.
Last edited by chulett on Mon Oct 18, 2010 9:37 am, edited 1 time in total.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Hi Sorry to interrupt but how do you achieve :mk_ds09 wrote:You can use the following logic to remove duplicates using the Transformer Stage, however for that you need to have data sorted.
Before using the transformer Stage, use Sort Stage to sort the data.
In Transformer Stage, take the
FirstRecordVar=SecondRecordVar
IncomingLnk.Value=FirstRecordVar
Then in constraint you can put constraint like
FirstRecordVar<>SecondRecordVar
This will ensure that duplicates records are not passed to the next stage.
Hope this helps !
FirstRecordVar=SecondRecordVar
?
What exact syntax is used for the same?
Re: how remove duplicate in transformer
Why not just use the de-duplicate stage?sureshbabu wrote:hi
can any body sugg me how do romoveduplecate in transformar stage useing stage varible
regards
sure