How to dived the data int diff targets

dudam · Post by **dudam** » Sun Jan 22, 2012 10:26 am

Hi,
Actually in my source is seq file have a 20 records
those 20 records have to move to two diff targets......
mean 10 records one target another 10 records into other target....
which stages we need to use how to design the job

For Example in source i have a 20 records
in first trg 1,2...10
second tgg 11...20
which stages have to use ..& how plz desing the job

plz help me on this....

Thanks,
DN

ray.wurlod · Post by **ray.wurlod** » Sun Jan 22, 2012 12:23 pm

Are there criteria that specify which rows go to which targets? The stage that splits the rows might be a Filter stage, a Switch stage or a Transformer stage.

Maximus_Jack · Post by **Maximus_Jack** » Wed Jan 25, 2012 10:12 am

Hi
i have tried this using a transformer it worked..
i used a stage variable

inside the stage variable

svx=1
if svx >20 then svx=1

in the 2 output link section i used the constraints
for records 1..10 .. 21..30 ...
constraint ( svx <11)

for records 11..20 ..31..40
contraints (svx>11)

...it may not be best solution. but it did the work...

cheers
dr

prakashdasika · Post by **prakashdasika** » Thu Jan 26, 2012 6:43 am

From the logic what i understood is that the value of svx will be added by 1 for every input row. This logic will only work if the config file has only one node. For multiple nodes the stage variable has multiple values on each node and it will add 1 to the current value depending on the partition.

Maximus_Jack · Post by **Maximus_Jack** » Thu Jan 26, 2012 11:21 am

will keeping the transformer in sequential mode work?? (sorry.. i cant check it right now)

or is there any other better way

qt_ky · Post by **qt_ky** » Fri Jan 27, 2012 12:40 am

Assuming that you are incrementing svx by 1, which is not shown, then setting the Transformer stage to sequential mode will work, but...

What about the poor records where svx = 11? According to your tests, they are getting left out.

Maximus_Jack · Post by **Maximus_Jack** » Fri Jan 27, 2012 11:25 am

finally did some tweaking and it worked..

Transformer in sequential mode

Stage variable
svx=0
Derivation: if svx >19 then "1" else svx+1 = svx

Output link1
Constraint: if svx <=10

Output link2
Constraint: if svx >= 11

qt_ky · Post by **qt_ky** » Fri Jan 27, 2012 7:04 pm

Congrats... you can mark the topic resolved!

chulett · Post by **chulett** » Fri Jan 27, 2012 11:06 pm

<cough> hitchhiker </cough>

ray.wurlod · Post by **ray.wurlod** » Sat Jan 28, 2012 12:49 am

Gesundheit!

qt_ky · Post by **qt_ky** » Sun Feb 19, 2012 8:14 am

Craig, how's your cough?

DSXchange

How to dived the data int diff targets

How to dived the data int diff targets

Re: How to dived the data int diff targets