Page 1 of 1

Multiple Links Collection

Posted: Thu Mar 17, 2005 8:38 am
by akhiln
Hi All,

I have a requirement like this....One of my Source table column is LED_TYPE, It will always have some predefined values like "A","B","C" etc.

If the value is "A", then i have to do one calculation. Similarly if the value is "B" then i have to do another calculation.

The issue is, In the first transformer stage i am giving the constraints for all the possible values and based on the values, data will go to the respective transformer stage(around 10 transformer stage). What i want is once the calculation is over i have to collect all the output links to a single transformer stage for further calculation? When i tried to do that i am getting an error like this "The destination stage cannot support any more stream input links"

I tried to use the Link Partitioner & collector stage also...but the problem is i cannot give the constraints in the Link Partitioner.

Please suggest some solution....

Thanks,
Akhil

Posted: Thu Mar 17, 2005 8:57 am
by DEVESHASTHANA
Hi Akhil.

well one solution for urs problem is to use DRS Stage and take the output of all the transformer in the input of DRS stage and in the out put take what all the columns u need,and in Before after stage create a temp table with all those colums and in out put select what all the colums which u need in the output of the DRS stage,


second solution for ur problem is to use a temporary sequential file for input and take output from that file what all the columns u want.



regards,

Devesh

Posted: Thu Mar 17, 2005 8:58 am
by Sainath.Srinivasan
Insert a file just before linking into the collector. Alternatively use an IPC stage.

Posted: Thu Mar 17, 2005 11:09 am
by akhiln
I was trying to collect all the links using a sequential file stage. But the problem is in all the previous transformer stages i will get one new column. All the new column will have a different value. So in the sequential file all the input links will have different columns.

Any other method of doing this

Posted: Thu Mar 17, 2005 1:17 pm
by kollurianu
what it is DRS STAGE ?

Posted: Thu Mar 17, 2005 1:23 pm
by chulett
The Dynamic Relational Stage, new in 7.5, something which allows you to use a single stage to connect to "any" relational source.

Posted: Thu Mar 17, 2005 1:59 pm
by ray.wurlod
DRS was introduced in 7.1 (perhaps even 7.0) when Peoplesoft elected to switch to DataStage. It allowed Peoplesoft to deploy canned jobs where the only change between their different customers might be database type.

Posted: Thu Mar 17, 2005 2:09 pm
by kollurianu
Thanks Ray and Craig.

Posted: Thu Mar 17, 2005 7:22 pm
by susanm
You should be able to use a Link Collector stage to collect the output links from your 10 transform stages. You do not need to use the Link Partitioner stage.


Ensure that you have set the job property of "Enable row buffer" to "Inter process".

Posted: Thu Mar 17, 2005 10:32 pm
by vmcburney
The main reason for splitting your data across multiple transformers is when you need to send certain columns through a plugin stage such as a qualitystage job or a shared container with a set column list. In your instance you may find it easier to do all types of calculations in one or more transformers using a combination of stage variables and routines to run your calculations.

A routine will give you a test button to let you test your calculations. You can write a different routine for each calculation.

Posted: Thu Mar 17, 2005 11:31 pm
by akhiln
i cannot use Link Collector stage also because all the input links have different columns.

I think i have to come up with a different strategy with regards to this issue. Planning to redesign the job in a different way.

Thanks for all the response