When a parallel job is configured to use more than one data partition (say 4) does DS create a seperate connection to the DB server (Oracle, DB2, etc) for each partition? Or is there only one connection between DS and the DB, and the data is not partitioned until it arrives on the DS server?
If the former then a DS parallel job has a larger impact on a DB server's connection pool than a server job does. Wouldn't you say?
_Wayne
DataStage Parallel Processing and DB I/O
Moderators: chulett, rschirm, roy
DataStage Parallel Processing and DB I/O
"The price of freedom is eternal vigilance."
-- Thomas Jefferson
-- Thomas Jefferson
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
That will depend on which stage type you choose and whether or not it's capable of parallel processing. For example, the Oracle Enterprise stage is capable of parallel processing but (unless it's a partitioned table) Oracle will only deliver a sequential stream when reading. However, a DB2 Connector (for example) can SELECT in parallel. An ODBC Connector stage might establish multiple sessions into the database (which can have database licensing issues).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Interesting. Looks like DS is optimized for DB2 ... not surprising. I guess if the Oracle result set is from a join then the input is sequential. Even with DB2 I guess only a single table (or view?) per SELECT is supported in parallel.
Thanks.
Thanks.
"The price of freedom is eternal vigilance."
-- Thomas Jefferson
-- Thomas Jefferson
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: