Page 1 of 1

datastage in a real-time environment?

Posted: Wed Nov 09, 2005 2:56 pm
by troywinston
Hey Guros,

Datastage is traditionally is a workhorse in a batch oriented environment. Just want to know can datastage perform in a real-time environment? If it can is this done by some form service calls or what, how can datastage operate in a real-time environment?If so anyperformance issues? Been doing some reserach on this but this seems to be a young concept for datastage because there is not really any information.
Any info?

Posted: Wed Nov 09, 2005 5:47 pm
by ketfos
Hi,

What is your defnition of real time enviornment?

Ketfos

Posted: Wed Nov 09, 2005 6:36 pm
by troywinston
Real-time environment example could be an Airline reservation system or a banking system.

Posted: Wed Nov 09, 2005 6:52 pm
by tcj
This is what you want/need.
The IBM WebSphere DataStage SOA Edition upgrade allows IBM WebSphere DataStage functions to be easily deployed as services, without requiring changes to the core logic of the overall job. These services are developed using a simple and intuitive wizard that creates all necessary components within your application server environment and generates a WSDL file for the service.

Posted: Wed Nov 09, 2005 7:08 pm
by ketfos
Hi,
I donot have personal experience in using DataStage like tool in real time enviornment like the airline systems you mentioned.

Base upon my readings, I can suggest you to look into Teradatta and Pervasive software System.
Both of them have been used in the Airline Industry.

Ketfos

Posted: Wed Nov 09, 2005 9:13 pm
by trokosz
Yes, DataStage can create a Server Job, Parallel Job, MVS Job and a "Real-Time Job". You need to install RTI (Real Time Integration) product. You can purchase this or purchase DataStage SOA which gives you DataStage EE and RTI. You also need to install the Web Services Pack.

So now what hapopens is a HTTP over SOAP or EJB can call a DataStage RTI Job....have whatever logic DataStage does .....and return back a answer to the event triggered....So RTI works tightly with WebSphere, WebLogic and JBOSS.....Actually RTI now comes with a embedded WebSphere (no surprise with IBM calling shots) but the embedded means run-time not full blown WebShpere....

Posted: Thu Nov 10, 2005 3:48 am
by ray.wurlod
Many large telecommunications companies run server or parallel jobs in "near real time" (small frequent batches) taking rows from mediation machines (maybe thousands per second, and maybe using multi-instance jobs to service multiple mediation machines). Mediation machines are basically between the switches and the database, and do things like adding the billing information.

The RTI services are not really intended for this style of operation; they are more intended for small numbers of rows at a time, for example to invoke QualityStage to perform address verification or certification behind a data entry application such as, for example, a reservation or booking system.