gud morning everyone,
I want to add a dataset having only one row and one column having the max surrogate key from previous stage to the incoming data which is not having this column plus millions of rows.
Moreover i have to use this value a the initial value in the surrogate key stage.
help me out guys.
thanks
join or merge in combining
Moderators: chulett, rschirm, roy
-
s_boyapati
- Premium Member
- Posts: 70
- Joined: Thu Aug 14, 2003 6:24 am
- Contact:
Re: join or merge in combining
Use row generator.jayantthakore wrote:gud morning everyone,
I want to add a dataset having only one row and one column having the max surrogate key from previous stage to the incoming data which is not having this column plus millions of rows.
Moreover i have to use this value a the initial value in the surrogate key stage.
help me out guys.
thanks
Do a lookup with that dataset, and use the Transformer to add that value to whatever value that is given for that particular record by the surrogate key stage.
Yeah, it includes the column in the 'millions of records' -- but what's the harm, really? It's all mostly in memory at this point, and you can filter out that column before migrating everything else forward beyond the transformer.
You do know you could pick and choose columns to migrate, right?
Yeah, it includes the column in the 'millions of records' -- but what's the harm, really? It's all mostly in memory at this point, and you can filter out that column before migrating everything else forward beyond the transformer.
You do know you could pick and choose columns to migrate, right?