how to send different partions data to different targets?

jhansi · Post by **jhansi** » Mon Jun 04, 2012 10:42 pm

i hav data like this
1
1
2
2
2
3
how to send all 1's to one target,all 2's to other target and all 3's to another target.
can i use partition tech?

stuartjvnorton · Post by **stuartjvnorton** » Mon Jun 04, 2012 11:39 pm

Why not just use a filter?

SURA · Post by **SURA** » Mon Jun 04, 2012 11:59 pm

If you have 4................400

ray.wurlod · Post by **ray.wurlod** » Tue Jun 05, 2012 12:40 am

Welcome aboard.

When's the interview?

Why the requirement to use partitioning technology?

It probably can be done, but would not be for the faint-hearted. As SURA suggests, the partitioning technology handles from one to a countably infinite number of processing nodes, so you would need to devise a naming strategy for your targets.

jhansi · Post by **jhansi** » Tue Jun 05, 2012 8:21 am

stuartjvnorton wrote:Why not just use a filter?

i can use filter or transformer by giving contraint like
DSLink5.sno =1 Then DSLink5.sno Else 0

.but what if i hav large amount of data?

BI-RMA · Post by **BI-RMA** » Tue Jun 05, 2012 8:42 am

I don't see how you are going to accomplish something that is going to give you a dynamic number of output links from whatever stage you might use.

To use partitioning techniques you would need to know how many keys of the type you provided you are going to get and the number of rows per key should be at least almost equal, because otherwise your partitioning will be inefficient due to skewing.

If you know which key values are to be expected, you can of course use transformer-constraints to split your data. You can also define an "Otherwise"-link, that will take all the data you did not provide specific links for.

SURA · Post by **SURA** » Tue Jun 05, 2012 5:32 pm

jhansi wrote:but what if i hav large amount of data?

Please understand clearly what the requirement is, and then start to think about the logic. Think max possibilities and ask questions with whoever given this task. Then start looking for solution!

stuartjvnorton · Post by **stuartjvnorton** » Tue Jun 05, 2012 5:44 pm

jhansi wrote:
stuartjvnorton wrote:Why not just use a filter?
i can use filter or transformer by giving contraint like
DSLink5.sno =1 Then DSLink5.sno Else 0

.but what if i hav large amount of data?

Think about it for a second.
When you partition, you can use a number of methods to work out which partition to put a record in.

In your case, you specified integer values. Using a modulus to split the output would be trivial.

DSXchange

how to send different partions data to different targets?

how to send different partions data to different targets?

Re: how to send different partions data to different targets