Real Time processing questions and WebSphere intergration

fuzzybear · Post by **fuzzybear** » Fri Sep 28, 2007 12:29 pm

Using version 8, before we embark on some potential real time processing work, I had these questions come from the application developers...

These questions revolve around being about to use SSA NAME-3 key generation.

Is DataStage capable of:

1) Invoking a Java VM, and executes a method

2) Invoking an EJB, a Servlet or a Web service, most likely in the Websphere app server as a part of the insert of a data set from a source

3) Inserting a message into a queue as a part of the insert of a data set from a source (If DataStage can put a message into the queue, it can be something simple as the ID, a MessageDrivenBean on Websphere could get it, get the name data and generate the keys for it.)

Any input would be helpful as we are still doing ramp up on the product!

thanks.

ray.wurlod · Post by **ray.wurlod** » Fri Sep 28, 2007 4:25 pm

Yes to all, but you will need to purchase some additional components, called the "Java PACK" and, possibly, "SOA Edition".

May I ask why you went with SSA rather than with QualityStage? it is far easier to integrate QualityStage into DataStage real-time processing than to do so with the SSA software.

fuzzybear · Post by **fuzzybear** » Tue Oct 02, 2007 9:30 am

ray.wurlod wrote:Yes to all, but you will need to purchase some additional components, called the "Java PACK" and, possibly, "SOA Edition".

May I ask why you went with SSA rather than with QualityStage? it is far ...

Thanks Ray. SSA-NAME3 is already used in the organization and by this particular application. Although we will investigate your suggestion about using QualityStage for the integration, which could be very possible for this project.

eostic · Post by **eostic** » Wed Oct 03, 2007 5:47 am

Hi fuzzybear...

You won't need to buy JavaPack, as it is included with v8 automatically, as is Web Services Pack. The SOA Edition under v8 has further capabilities and is now called WISD (WebSphere Information Services Director).

Based on our comments above, JavaPack is probably going to be your initial foray into interaction with SSA, assuming they provide a java api.

Are you only dealing with JMS queues? Certainly the MQ Stages are on your canvas too, and might be a viable option if you are using MQSeries.

Dealing with WebSphere EJBs is do-able, but has it's challenges. This has little to do with DataStage and JavaPack and more with the fact that WebSphere is unique in having java client side requirements that complicate JNDI issues.

JavaPack is pretty cool --- it easily lets you integrate your classes directly with the DataStage engine at run time... your class can read and write "rows" to and from the "Links" of your job, as well as do introspection on the job to see what links actually exist, the columns that are on those links, and what their datatypes are. You can also get values from the DS developer (often connectivty information that your class needs at runtime). The javapack is well documented, but let us know if you have any questions.

Ernie

fuzzybear · Post by **fuzzybear** » Wed Oct 03, 2007 8:33 am

Hi Ernie,

Thanks for the feedback, we are just investigating this project now and what DataStage can do for us. Since it will be a bit of a paradigm shift from typical batch work we had been doing, this would be a great project to get us into the real time space. We will likely conduct a DataStage technical test into the application and see how it all works out. We have pulled up the relevant docs and will review.

Thanks for the feedback!
Justin