How to use XML stages to handle real time data transform?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
olgc
Participant
Posts: 145
Joined: Tue Nov 18, 2003 9:00 am

How to use XML stages to handle real time data transform?

Post by olgc »

Hi there,

Under ReaL Time in the Datastage Designer, there are three stages: XMP_INPUT, XML_TRANSFORMER and XML_OUTPUT. How are these stages used to handle real time data transform? Does the source operation system generate XML file with its operations as the source XML File? Or messaging service do this? Why that's the case?

Thanks,
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

They become truly 'real time' when you use them in an SOA enabled job published as a Web Service. Yes, that means you have to purchase the SOA Edition, so the category is a bit of a misnomer out of the box. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
olgc
Participant
Posts: 145
Joined: Tue Nov 18, 2003 9:00 am

Post by olgc »

But how SOA works? Subscribe and inform? Or event-driven? Does this mean to modify the operational applications to generate events?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Best to post questions like that over in the SOA forum. As I said, it allows you to publish a job as a Web Service with a choice of different bindings - SOAP over HTTP, JMS and EJB from what I recall.
-craig

"You can never have too many knives" -- Logan Nine Fingers
olgc
Participant
Posts: 145
Joined: Tue Nov 18, 2003 9:00 am

Post by olgc »

Can Datastage handle the real time like Sunopsis?
It is said that using Sunopsis, It first journize the source table, which means tracking the source data change. Then the job is set to only use the data that has changed. The job itself is developed as usual. In this approach, it makes real time ETL a piece of cake. No jargon SOA.
Post Reply