hello,
I am working with legacy data that doesnot have key column in a table.
beacuase of this, there are duplicate records of columns that should have only one record.
I need to apply logic such that based on the business rule, one of this record is picked for extraction.
Please let me know if we can do group rows based on key and compare to select row based on rule and drop the rest all .
Please let me know if it is possible.
Can we use pivot to convert the rows and make it horizonal columns.. and then compare the horizontal records.
thanks
-ds1
Use of Pivot
Moderators: chulett, rschirm, roy
Which is exactly what the Pivot stage does. Don't confuse "key" with "index" or "primary key" or anything of that ilk. For the Pivot stage, you mark as "Key" the base column(s) that should be included in every row it pivots out. This is all documented in the pivot.pdf manual in your Docs directory.
Just to be sure we're all on the same page, why don't you include some examples? Show us examples of this legacy data and what you need that same data to look like after the pivot / deduplication.
Just to be sure we're all on the same page, why don't you include some examples? Show us examples of this legacy data and what you need that same data to look like after the pivot / deduplication.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers
Sounds like a possibility for an aggregator to me.combine multiple rows into 1 row
Should we keep guessing?... or maybe you could follow-up on Craig's request...
MikeJust to be sure we're all on the same page, why don't you include some examples? Show us examples of this legacy data and what you need that same data to look like after the pivot / deduplication.
So a vertical rather than the horizontal pivot the stage provides. Search the forums for "vertical pivot", the technique has been discussed here a time or two. And please do provide some examples, examples do generally help as long as they are real.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers