Parallel Shared Container

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Nageshsunkoji
Participant
Posts: 222
Joined: Tue Aug 30, 2005 2:07 am
Location: pune
Contact:

Parallel Shared Container

Post by Nageshsunkoji »

Hi all,

I Created a Parallel Conatiner with the content of 4 lookups in the container and i am using this container in 4 of my jobs. There are no dependecies in my 4 jobs. I am running these jobs through Sequence.
So, my questions is when i tried to use shared container parallely in 4 jobs, whether is it improve performance or just reusability :?: Please clarify, is it Parallel shared containers improve performance or it saves time when we are designing jobs :?:

Regards
Nagesh.
NageshSunkoji

If you know anything SHARE it.............
If you Don't know anything LEARN it...............
sanjay
Premium Member
Premium Member
Posts: 203
Joined: Fri Apr 23, 2004 2:22 am

Re: Parallel Shared Container

Post by sanjay »

Hi
It is to just save time when we are designing jobs .

Sanjay
Nageshsunkoji wrote:Hi all,

I Created a Parallel Conatiner with the content of 4 lookups in the container and i am using this container in 4 of my jobs. There are no dependecies in my 4 jobs. I am running these jobs through Sequence.
So, my questions is when i tried to use shared container parallely in 4 jobs, whether is it improve performance or just reusability :?: Please clarify, is it Parallel shared containers improve performance or it saves time when we are designing jobs :?:

Regards
Nagesh.
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

As Sanjay has already mentioned, the gain is potentially in design-time because of reuseability but they have nothing to do with performance gains (either in PX or in Server). Shared containers are actually loaded into the job when it is compiled, so the resulting object code is going to be the same whether you put the stages into a shared container or straight into your job.
Nageshsunkoji
Participant
Posts: 222
Joined: Tue Aug 30, 2005 2:07 am
Location: pune
Contact:

Post by Nageshsunkoji »

Hi Arnd,

Thanks for your reply.My main concern & understanding regarding shared container performance is, if you use a shared container in 4 jobs it will use same processor, that will save our space( Like combinability mode in each stage).Please, correct me if it is wrong ?

Regards
Nagesh.
NageshSunkoji

If you know anything SHARE it.............
If you Don't know anything LEARN it...............
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

As per the previous descriptions, a shared container is copied into a job at compile-time. The shared container itself is not used at runtime, since it's links and stages have been duplicated and copied into the actual DataStage job.

Since at runtime there is no such thing as a "shared container", it doesn't matter how many jobs that are running used that container in their design. It won't use the same processes. Combinability mode is something very different and doesn't affect "space" at all, but how the job compiler tries to optimize stages.
sanjay
Premium Member
Premium Member
Posts: 203
Joined: Fri Apr 23, 2004 2:22 am

Post by sanjay »

Hi
what is meant by Combinability mode in datastage.

Sanjay

ArndW wrote:As per the previous descriptions, a shared container is copied into a job at compile-time. The shared container itself is not used at runtime, since it's links and stages have been duplicated and copied into the actual DataStage job.

Since at runtime there is no such thing as a "shared container", it doesn't matter how many jobs that are running used that container in their design. It won't use the same processes. Combinability mode is something very different and doesn't affect "space" at all, but how the job compiler tries to optimize stages.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Search 8)

-Kumar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Thread hijack!

This thread began talking about shared containers. A new thread should have been started for the thread on combinability, which is totally unrelated to shared containers.

Use of shared containers has no effect on "performance" - whatever that means. Internally, the components need longer human-readable names (job.container.stage.link) but DataStage uses DSRIDs which are sorted out when the job is compiled.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply