datastage in a real-time environment?

troywinston · Post by **troywinston** » Wed Nov 09, 2005 2:56 pm

Hey Guros,

Datastage is traditionally is a workhorse in a batch oriented environment. Just want to know can datastage perform in a real-time environment? If it can is this done by some form service calls or what, how can datastage operate in a real-time environment?If so anyperformance issues? Been doing some reserach on this but this seems to be a young concept for datastage because there is not really any information.
Any info?

ketfos · Post by **ketfos** » Wed Nov 09, 2005 5:47 pm

Hi,

What is your defnition of real time enviornment?

Ketfos

troywinston · Post by **troywinston** » Wed Nov 09, 2005 6:36 pm

Real-time environment example could be an Airline reservation system or a banking system.

tcj · Post by **tcj** » Wed Nov 09, 2005 6:52 pm

This is what you want/need.

The IBM WebSphere DataStage SOA Edition upgrade allows IBM WebSphere DataStage functions to be easily deployed as services, without requiring changes to the core logic of the overall job. These services are developed using a simple and intuitive wizard that creates all necessary components within your application server environment and generates a WSDL file for the service.

ketfos · Post by **ketfos** » Wed Nov 09, 2005 7:08 pm

Hi,
I donot have personal experience in using DataStage like tool in real time enviornment like the airline systems you mentioned.

Base upon my readings, I can suggest you to look into Teradatta and Pervasive software System.
Both of them have been used in the Airline Industry.

Ketfos

trokosz · Post by **trokosz** » Wed Nov 09, 2005 9:13 pm

Yes, DataStage can create a Server Job, Parallel Job, MVS Job and a "Real-Time Job". You need to install RTI (Real Time Integration) product. You can purchase this or purchase DataStage SOA which gives you DataStage EE and RTI. You also need to install the Web Services Pack.

So now what hapopens is a HTTP over SOAP or EJB can call a DataStage RTI Job....have whatever logic DataStage does .....and return back a answer to the event triggered....So RTI works tightly with WebSphere, WebLogic and JBOSS.....Actually RTI now comes with a embedded WebSphere (no surprise with IBM calling shots) but the embedded means run-time not full blown WebShpere....

ray.wurlod · Post by **ray.wurlod** » Thu Nov 10, 2005 3:48 am

Many large telecommunications companies run server or parallel jobs in "near real time" (small frequent batches) taking rows from mediation machines (maybe thousands per second, and maybe using multi-instance jobs to service multiple mediation machines). Mediation machines are basically between the switches and the database, and do things like adding the billing information.

The RTI services are not really intended for this style of operation; they are more intended for small numbers of rows at a time, for example to invoke QualityStage to perform address verification or certification behind a data entry application such as, for example, a reservation or booking system.