Page 1 of 1

UNION and FULL outer join

Posted: Mon Sep 19, 2005 2:37 pm
by DeepakCorning
I want to confirm from you guys , Is it possible to do full outer joins and UNIONS in DS without any problem? And I think the only way to do is to use User defined SQL right??

Re: UNION and FULL outer join

Posted: Mon Sep 19, 2005 3:14 pm
by LogicDude
DeepakCorning wrote:I want to confirm from you guys , Is it possible to do full outer joins and UNIONS in DS without any problem? And I think the only way to do is to use User defined SQL right??
Yes. I have done that in User Defined SQL with out any problem.

Posted: Mon Sep 19, 2005 3:57 pm
by kcbland
You can achieve the same effect with a series of hash files and passes thru the data. But it would not be the elegant solution. If a UNION is what you desire, that is a database action best suited to be done in a database. a UNION ALL can be achieved by simply concatenating like structured text files together. A full outer join can be achieved thru a similar concatenation of like structured files followed by a merging operation using something like the Aggregator stage to group by a the merging key fields and MAX(xxx) operating the remaining fields.

Posted: Mon Sep 19, 2005 10:38 pm
by rleishman
Like kcbland sez about UNION ALL - you can do it by concatenating text files. A nice way of doing this with DS is to have each of your separate SQLs feeding into a Link Collector stage.

Posted: Mon Sep 19, 2005 11:46 pm
by hari_pulakanam

Posted: Tue Sep 20, 2005 12:43 am
by ray.wurlod
These (Funnel and Remove Duplicates) are parallel stage types, not available in server jobs.

Posted: Wed Jan 18, 2006 12:26 am
by kumar_j
u can do this by using with merge stage( in that there r so many options to do the join options )
complete set is for full outer join
just confirm