Multiple Links Collection

akhiln · Post by **akhiln** » Thu Mar 17, 2005 8:38 am

Hi All,

I have a requirement like this....One of my Source table column is LED_TYPE, It will always have some predefined values like "A","B","C" etc.

If the value is "A", then i have to do one calculation. Similarly if the value is "B" then i have to do another calculation.

The issue is, In the first transformer stage i am giving the constraints for all the possible values and based on the values, data will go to the respective transformer stage(around 10 transformer stage). What i want is once the calculation is over i have to collect all the output links to a single transformer stage for further calculation? When i tried to do that i am getting an error like this "The destination stage cannot support any more stream input links"

I tried to use the Link Partitioner & collector stage also...but the problem is i cannot give the constraints in the Link Partitioner.

Please suggest some solution....

Thanks,
Akhil

DEVESHASTHANA · Post by **DEVESHASTHANA** » Thu Mar 17, 2005 8:57 am

Hi Akhil.

well one solution for urs problem is to use DRS Stage and take the output of all the transformer in the input of DRS stage and in the out put take what all the columns u need,and in Before after stage create a temp table with all those colums and in out put select what all the colums which u need in the output of the DRS stage,

second solution for ur problem is to use a temporary sequential file for input and take output from that file what all the columns u want.

regards,

Devesh

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Thu Mar 17, 2005 8:58 am

Insert a file just before linking into the collector. Alternatively use an IPC stage.

akhiln · Post by **akhiln** » Thu Mar 17, 2005 11:09 am

I was trying to collect all the links using a sequential file stage. But the problem is in all the previous transformer stages i will get one new column. All the new column will have a different value. So in the sequential file all the input links will have different columns.

Any other method of doing this

kollurianu · Post by **kollurianu** » Thu Mar 17, 2005 1:17 pm

what it is DRS STAGE ?

chulett · Post by **chulett** » Thu Mar 17, 2005 1:23 pm

The Dynamic Relational Stage, new in 7.5, something which allows you to use a single stage to connect to "any" relational source.

ray.wurlod · Post by **ray.wurlod** » Thu Mar 17, 2005 1:59 pm

DRS was introduced in 7.1 (perhaps even 7.0) when Peoplesoft elected to switch to DataStage. It allowed Peoplesoft to deploy canned jobs where the only change between their different customers might be database type.

kollurianu · Post by **kollurianu** » Thu Mar 17, 2005 2:09 pm

Thanks Ray and Craig.

susanm · Post by **susanm** » Thu Mar 17, 2005 7:22 pm

You should be able to use a Link Collector stage to collect the output links from your 10 transform stages. You do not need to use the Link Partitioner stage.

Ensure that you have set the job property of "Enable row buffer" to "Inter process".

vmcburney · Post by **vmcburney** » Thu Mar 17, 2005 10:32 pm

The main reason for splitting your data across multiple transformers is when you need to send certain columns through a plugin stage such as a qualitystage job or a shared container with a set column list. In your instance you may find it easier to do all types of calculations in one or more transformers using a combination of stage variables and routines to run your calculations.

A routine will give you a test button to let you test your calculations. You can write a different routine for each calculation.

akhiln · Post by **akhiln** » Thu Mar 17, 2005 11:31 pm

i cannot use Link Collector stage also because all the input links have different columns.

I think i have to come up with a different strategy with regards to this issue. Planning to redesign the job in a different way.

Thanks for all the response