I wanted to know how can we leverage Datastage PX features with Grid Computing?
Does DS support grid computing Ascential/IBM market Datastage enterprise edition as grid enable integration tool.
If yes then how can we use pool of server for running the datastage jobs?
I understand that datastage PX treats grid as MPP cluster. And if we want to use cluster what parameter values needs to set for setting up DataStage server. eg configuration file, rsh etc etc.
SK
Datastage PX features for Cluster or Grid
Moderators: chulett, rschirm, roy
-
- Charter Member
- Posts: 35
- Joined: Sun Jan 16, 2005 8:39 am
- Location: US
I would suggest starting in the Parallel Job Developer's Guide, pages 58-9 onwards. This details the basic configuration setup required by PX to run on a distributed system configuration - as you've stated this is the way that a future true grid solution will work with PX jobs. Although this is not yet a true grid construct, it will distribute the load across heavy servers - the next generation(s) might have capabilities to distribute to "light" processing nodes. If you think about it, a true grid for ETL jobs isn't always a benefit, since the time spent sending requests out and returning result sets or distributed writing to databases is higher than the amount of processiong time gained by doing things in parallel.
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There was a paper presented at IBM Information Integration Live last November in Las Vegas on using DataStage EE in a grid environment. Can you get access to the papers from this conference?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Charter Member
- Posts: 35
- Joined: Sun Jan 16, 2005 8:39 am
- Location: US