MQ Series
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
When I looked into this for version 6, you had to have to have an MQ Server running on the DataStage server. The MQ client wasn't enough. Can anyone from Ascential comment on this? Has this changed?
Jim,
We didn't want to incur the cost for MQ Server licensing on the DataStage server because of cost, so one of the developers on our team wrote a JAVA program using the MQ Client libraries to read a flat file and enqueue each row onto our Queue. We invoke this JAVA program from a shell script, which in turn gets invoked from a DataStage Job Sequencer job.
Regards,
Tony Stark
Jim,
We didn't want to incur the cost for MQ Server licensing on the DataStage server because of cost, so one of the developers on our team wrote a JAVA program using the MQ Client libraries to read a flat file and enqueue each row onto our Queue. We invoke this JAVA program from a shell script, which in turn gets invoked from a DataStage Job Sequencer job.
Regards,
Tony Stark
Last edited by tonystark622 on Fri Jun 04, 2004 8:57 am, edited 2 times in total.
Wooooo doggie. That cant be. I dont want to host the que i just want to read from one!!tonystark622 wrote:When I looked into this for version 6, you had to have to have an MQ Server running on the DataStage server. The MQ client wasn't enough. Can anyone from Ascential comment on this? Has this changed?
Regards,
Tony Stark
Sure I need help....But who dosent?
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
I just cant beleve that this is the only way. The only error that I am getting is that it is missing a mq.dll. I just dont see how DS would require the entire MQ servertonystark622 wrote:You didn't have to host the queue on the DataStage server. The queue could be on another MQ server, and the server on your DataStage server would treat it as a remote queue. But we still would have had pay for licenses for both servers.
Tony
Sure I need help....But who dosent?
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
I found it hard to believe, as well. And it may have changed on v7 or v7.1.0. As of version 6, the MQ stage was "bound" to the server libraries, not the client libraries. Or so I was told by Ascential.just cant beleve that this is the only way.
Can you find the DLL it's missing? If so, maybe you can modify the path or shared library path (or whatever the right one is for windows) in the DSENV file.The only error that I am getting is that it is missing a mq.dll.
Good Luck,
Tony
tonystark622 wrote:When I looked into this for version 6, you had to have to have an MQ Server running on the DataStage server. The MQ client wasn't enough. Can anyone from Ascential comment on this? Has this changed?
Jim,
We didn't want to incur the cost for MQ Server licensing on the DataStage server because of cost, so one of the developers on our team wrote a JAVA program using the MQ Client libraries to read a flat file and enqueue each row onto our Queue. We invoke this JAVA program from a shell script, which in turn gets invoked from a DataStage Job Sequencer job.
Regards,
Tony Stark
hehehehe and ill pull the time to do that out of thin air
man u would think that someone at DS would have thought this out....but maybe they did. How do you check kick backs in a company like DS?
Sure I need help....But who dosent?
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
To their credit, Ascential did mention that we should put in official request for this functionality (that we can use MQ Client only libraries) and if they had enough requests they would see about implementing this.hehehehe and ill pull the time to do that out of thin air
man u would think that someone at DS would have thought this out....but maybe they did. How do you check kick backs in a company like DS?
So, How do we put in an official request?
Thanks,
Tony
Ill second that requesttonystark622 wrote:To their credit, Ascential did mention that we should put in official request for this functionality (that we can use MQ Client only libraries) and if they had enough requests they would see about implementing this.hehehehe and ill pull the time to do that out of thin air
man u would think that someone at DS would have thought this out....but maybe they did. How do you check kick backs in a company like DS?
So, How do we put in an official request?
Thanks,
Tony
Sure I need help....But who dosent?
I would seek some guidance from Ascential on the future of MQ in DataStage. My feeling is that RTI will be the preferred method and this stage will be left to it's own devices.
My opinion would be that this stage began life as a neato idea from the "two-drink" minimum boys over in Marketing and originally coded as such. We are using it in a production system but it was a long hard pull to get it up to snuff. It works great now.
***Warning***
Using this stage may involve a radical paradigm shift from the normal BATCH processing so dearly loved by the Guys Of DataStage who inhabit this site. If real-time is your aim, then consider the concepts of transactions, restartability and recovery. There is no such thing as a transaction when using this stage so you must build it yourself. Recoverability and restartability are simple as long as you don't do a destructive read.
My opinion would be that this stage began life as a neato idea from the "two-drink" minimum boys over in Marketing and originally coded as such. We are using it in a production system but it was a long hard pull to get it up to snuff. It works great now.
***Warning***
Using this stage may involve a radical paradigm shift from the normal BATCH processing so dearly loved by the Guys Of DataStage who inhabit this site. If real-time is your aim, then consider the concepts of transactions, restartability and recovery. There is no such thing as a transaction when using this stage so you must build it yourself. Recoverability and restartability are simple as long as you don't do a destructive read.
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
That's true. I had forgotten the RTI stuff. I wonder if there are any restrictions (like server must be installed on DataStage server) with that? Of course, there is a charge for RTI and none for MQ.
Like I said, we worked around it by writing our transactions to an XML file and then running an external JAVA program to read this file and enqueue each row to the MQ Queue.
Tony
Like I said, we worked around it by writing our transactions to an XML file and then running an external JAVA program to read this file and enqueue each row to the MQ Queue.
Tony
I have no Idea what RTI is. can u clue me in?tonystark622 wrote:That's true. I had forgotten the RTI stuff. I wonder if there are any restrictions (like server must be installed on DataStage server) with that? Of course, there is a charge for RTI and none for MQ.
Like I said, we worked around it by writing our transactions to an XML file and then running an external JAVA program to read this file and enqueue each row to the MQ Queue.
Tony
Jim
Sure I need help....But who dosent?
-
- Premium Member
- Posts: 483
- Joined: Thu Jun 12, 2003 4:47 pm
- Location: St. Louis, Missouri USA
With version 7 Ascential added "Real Time Integration" capabilities to DataStage. You can have automatic load balancing between DataStage servers, jobs that can be called as web services (always running), jobs that access Web Services as a data source/target, you can access job status/job control functions through web services, you can read/write data to JMS (JAVA Message queue), JAVA Beans, and another "binding" that I can't remember. Somewhere in there is the ability to read/write Websphere MQ Queues, I think.
Lots of cool stuff. There's more info on the Ascential web site, though, I can't point you at it.
Hope this helps,
Tony
Lots of cool stuff. There's more info on the Ascential web site, though, I can't point you at it.
Hope this helps,
Tony
Would there be a pdf on ths in the install documents?tonystark622 wrote:With version 7 Ascential added "Real Time Integration" capabilities to DataStage. You can have automatic load balancing between DataStage servers, jobs that can be called as web services (always running), jobs that access Web Services as a data source/target, you can access job status/job control functions through web services, you can read/write data to JMS (JAVA Message queue), JAVA Beans, and another "binding" that I can't remember. Somewhere in there is the ability to read/write Websphere MQ Queues, I think.
Lots of cool stuff. There's more info on the Ascential web site, though, I can't point you at it.
Hope this helps,
Tony
Jim
Sure I need help....But who dosent?