To make DB2 read in parallel

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
vnspn
Participant
Posts: 165
Joined: Mon Feb 12, 2007 11:42 am

To make DB2 read in parallel

Post by vnspn »

Hi,

We have a parallel job where we use a DB2 API stage as the source. By default, this stage runs Sequentially.

As we needed to improve the performance, we changed the property of the stage to run Parallely. The source table originally had 1 million records. But what we noticed was, when the job is run on a 4 way parallel, the records out of the DB2 stage was 4 million. Each record is read 4 times; looks like each node reads the same record once.

Is there a way we could make the DB2 stage to read parallely the way we want to; so as to improve the preformance?

Thanks.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

No.

You use a DB2 Enterprise stage for that.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
balajisr
Charter Member
Charter Member
Posts: 785
Joined: Thu Jul 28, 2005 8:58 am

Post by balajisr »

And you need DB2 DPF license as well.
stefanfrost1
Premium Member
Premium Member
Posts: 99
Joined: Mon Sep 03, 2007 7:49 am
Location: Stockholm, Sweden

Post by stefanfrost1 »

and you have to use read method table or a simple sql that doesn't have group by or joins and similar stuff
-------------------------------------
http://it.toolbox.com/blogs/bi-aj
my blog on delivering business intelligence using agile principles
vnspn
Participant
Posts: 165
Joined: Mon Feb 12, 2007 11:42 am

Post by vnspn »

Thanks All for your inputs.

We would look into having the DB2 Enterprise stage configured. Looks like it has a long set of configuration steps.

Thanks.
Post Reply