SOA, Java Pack or other solution for given problem
Posted: Mon Apr 30, 2007 12:52 am
Hi All,
I would like to know what are all the things we can achieve from Java Pack?
In short the requirement is as below:
We need to create a web based application/package/service which will do following tasks in batch as per the scheduler and configuration information:
1. Fetch files from various vendor locations using Java using various protocols.
2. Uncompress it, decrypt it and store the file on ETL server
3. To process this data faster use Datastage EE for transformation and loading data in oracle target
In the proposed solution jobs will be executed in the batch and on demand basis. On demand means, we may deploy the whole package to various group so that they can take care of processing particular category vendor data. If job related to some feed/file fails that group should be able to re-execute only that job from web based User Interface.
My question is can we achieve this web-service or invocation of DS Job using Java/ Java Pack?
Can we invoke DS services through JMS and EJB client. So, if we have a JMS queue, couldnt the Java framework post messages to this queue and DS will read the messages from this queue and invoke other jobs? Essentially, the service in DS listening for JMS messages will be the controller within Datastage and we can build a config for DS similar to the Java framework (to define what DS job to process for what kind of JMS message request).
If it is not possible using Java Pack can we achieve this using Datastge SOA Edn?
Thanks in advance.
-Amit
I would like to know what are all the things we can achieve from Java Pack?
In short the requirement is as below:
We need to create a web based application/package/service which will do following tasks in batch as per the scheduler and configuration information:
1. Fetch files from various vendor locations using Java using various protocols.
2. Uncompress it, decrypt it and store the file on ETL server
3. To process this data faster use Datastage EE for transformation and loading data in oracle target
In the proposed solution jobs will be executed in the batch and on demand basis. On demand means, we may deploy the whole package to various group so that they can take care of processing particular category vendor data. If job related to some feed/file fails that group should be able to re-execute only that job from web based User Interface.
My question is can we achieve this web-service or invocation of DS Job using Java/ Java Pack?
Can we invoke DS services through JMS and EJB client. So, if we have a JMS queue, couldnt the Java framework post messages to this queue and DS will read the messages from this queue and invoke other jobs? Essentially, the service in DS listening for JMS messages will be the controller within Datastage and we can build a config for DS similar to the Java framework (to define what DS job to process for what kind of JMS message request).
If it is not possible using Java Pack can we achieve this using Datastge SOA Edn?
Thanks in advance.
-Amit