DataStage Connections Issue

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The maximum number of connections to Oracle is something set in Oracle, not in DataStage.

Sweet talk your DBA with a request to increase the maximum but, if I were the DBA, you would need to have a very good case. Can you not run fewer jobs at the same time? Maybe do some of your extractions ahead of time into staging areas (Data Sets)?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Raftsman
Premium Member
Premium Member
Posts: 335
Joined: Thu May 26, 2005 8:56 am
Location: Ottawa, Canada

Post by Raftsman »

You will see an increase in performance if you decrease the node configuration. The startup time for 8 node will be high and with 1 or two node alot less. I would experiment with the node configuration. You will be very surprised.
Jim Stewart
John Smith
Charter Member
Charter Member
Posts: 193
Joined: Tue Sep 05, 2006 8:01 pm
Location: Australia

Post by John Smith »

It may be even more than 320 * 8 connections opened because if your jobs have more than one Oracle EE stage e.g an input stage and and output stage then that's 2 connections per job. Best to scale back number of jobs that you run at the same time.
John Smith
Charter Member
Charter Member
Posts: 193
Joined: Tue Sep 05, 2006 8:01 pm
Location: Australia

Post by John Smith »

one other option is to split your jobs into a "prepare" jobs and generic load job. the prepare jobs land data into datasets. then apply the loads in batches.
Post Reply