Load 0.5 million records into DB2 stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mailravi.dw@gmail.com
Participant
Posts: 19
Joined: Sat Dec 19, 2009 8:50 am
Location: Chennai

Load 0.5 million records into DB2 stage

Post by mailravi.dw@gmail.com »

Hi Experts,

I have 0.5 million records. I am planing for job design as follows.

Dataset --> Transformer --> DB2 Stage

My target table is not Partitioned. Please suggest me, Whether DB2 API stage or DB2 Enterprise Stage would give more optimisation.
csrazdan
Participant
Posts: 127
Joined: Wed May 12, 2004 6:03 pm
Location: Chicago IL

Post by csrazdan »

If your database is not partitioned you do not have option of using DB2EE Stage. If you are on 7.x version your only option is to use DB2 API stage unless you decide to use ODBC. For 8.x you have an option of using Common Connector stage which sits somewhere in between DB2EE and DB2 API Stage as far as performence is concerned.
Assume everything I say or do is positive
mailravi.dw@gmail.com
Participant
Posts: 19
Joined: Sat Dec 19, 2009 8:50 am
Location: Chennai

Post by mailravi.dw@gmail.com »

Thanks for the clarification.

If i enabled execution mode as parallel for DB2 API stage then is there any performance improvement. I could see default execution mode is Sequential.
MT
Premium Member
Premium Member
Posts: 198
Joined: Fri Mar 09, 2007 3:51 am

Post by MT »

mailravi.dw@gmail.com wrote:Thanks for the clarification.

If i enabled execution mode as parallel for DB2 API stage then is there any performance improvement. I could see default execution mode is Sequential.
Hi,

the DB2 API stage is a sequential stage.
You could tune it by setting approprate ARRAY SIZE and TRANSACTION SIZE though.

An alternative is the DB2 LOAD stage which uses the native DB2 LOAD tool which is designed to transfer bigger amounts of data into DB2.
But you need some DB2 help for setting the right parameters for it - so ask your DBA to help you.

best regards
Michael
Post Reply