Using Parallel Shared Container

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sinhasaurabh014
Participant
Posts: 86
Joined: Wed Apr 02, 2008 2:32 am
Location: Bangalore

Using Parallel Shared Container

Post by sinhasaurabh014 »

Hi,
I am trying to use shared container for the first time and am facing some issues. When I searched through the forum, I couldn't find somebody who had faced such a basic elemntary problem. :oops:

I have a parallel shared container consisting of a row generator , Transformer and sequential file with two links: lnk1 from row gen to transformer and lnk2 from transformer to sequential file.

I am using/trying to use this shared container in a simple parallel job as below:

Code: Select all

SEQ FILE-->SHARED CON-->TRANSFORMER-->SEQ FILE
Through input seq file stage, I will pass each record to container and take output from container to transformer and ultimately to target seq stage. However, when I try to configure the shared container stage in the job, (I dragged and dropped on the canvas, I guess it is referential) I am not able to do any link mapping --neither in the input nor in the output properties.
I have kept the input link metadata same as lnk1 in the shared container.

Am i doing any wrong, Is the design feasible? Please help.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What does this job look like when you deconstruct the container? (Show us.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
sinhasaurabh014
Participant
Posts: 86
Joined: Wed Apr 02, 2008 2:32 am
Location: Bangalore

Design of shared container

Post by sinhasaurabh014 »

Hi Ray
My shared container design looked like

Code: Select all

Row Generator----------------->Transformer------------------>Sequential File
                              lnk1                                    lnk2
After some trial, I have been able to fix this by replacing Row generator with container input and sequential file as container output.

Code: Select all

Container Input------------>Transformer--------->Container Output
I think a shared container design is supposed to be this way. Is it?
meet_deb85
Premium Member
Premium Member
Posts: 132
Joined: Tue Sep 04, 2007 11:38 am
Location: NOIDA

Post by meet_deb85 »

Its correct considering you want to pass input to the container
Palci
Participant
Posts: 14
Joined: Thu Nov 17, 2011 10:56 am

Re: Design of shared container

Post by Palci »

So does it mean that only for the transformer you are using a SC. Why do so ?? Directly put the transformer in the job. If its very complex logic then only use the SC. And also did you check the output columns validity??
Post Reply