need real time scenario
Moderators: chulett, rschirm, roy
need real time scenario
hi am alex. i need details in real time how parallel stage will be working, and what is the main difference between server and parallel stage.if any one have knows pls explain the full parallel and server stage how it will be working in real time envoirnment
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Welcome aboard. Is this an interview question?
If not, can you give a scenario in the context of which you'd like an answer? There isn't really any "one size fits all" answer.
If not, can you give a scenario in the context of which you'd like an answer? There isn't really any "one size fits all" answer.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Charter Member
- Posts: 193
- Joined: Tue Sep 05, 2006 8:01 pm
- Location: Australia
Hi alex
though there are ways you can make it real time it's real strength is in batch processing. what sort of real time environment do you have?
Must it be real time or can it be near real time meaning micro batches that run every 30 seconds? Like Ray said you need to provide the context.
Also it would be advisable to get some training if you are new to the product.
JS
though there are ways you can make it real time it's real strength is in batch processing. what sort of real time environment do you have?
Must it be real time or can it be near real time meaning micro batches that run every 30 seconds? Like Ray said you need to provide the context.
Also it would be advisable to get some training if you are new to the product.
JS
Ok....so then perhaps you can just tell us more about the real time updates that you are looking at...we can all discuss the DataStage specifics later, as well as the use cases.....
...what is the input? A flat file? A database? a message queue?
Ernie
...what is the input? A flat file? A database? a message queue?
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
its an database, like ms acess, i like to know if we using parallel enviornment how the update will update in target database.and what the difference between server enviornment target database updation andtarget database updation. in real time take eg like bank they need to update an new column and new datas in target database,in the same time they need to update the new column and new datas all over thier geographical location, in this case what is the job for parallel and server
enviornment how they will updateand what is the difference between the two.what envoirnment make more efficent in updation and why?
enviornment how they will updateand what is the difference between the two.what envoirnment make more efficent in updation and why?
-
- Charter Member
- Posts: 193
- Joined: Tue Sep 05, 2006 8:01 pm
- Location: Australia
Hi ,alex007 wrote:its an database, like ms acess, i like to know if we using parallel enviornment how the update will update in target database.and what the difference between server enviornment target database updation andtarget database updation. in real time take eg like bank they need to update an new column and new datas in target database,in the same time they need to update the new column and new datas all over thier geographical location, in this case what is the job for parallel and server
enviornment how they will updateand what is the difference between the two.what envoirnment make more efficent in updation and why?
If it is ms access in real time, then forget about using Datastage be it Server or Parellel. And if it is a banking type transactions again don't use Datastage. Your real time application should be developed using a different tool/product.I am surprised with the combination though MS Access and Banking Also surprised that you would use MS Access for a distributed geographical solution...
I must have been lagging behind in the technological advancement of Microsoft...
surely you can't be serious....
JS
-
- Participant
- Posts: 27
- Joined: Thu Mar 20, 2008 11:55 am
-
- Charter Member
- Posts: 193
- Joined: Tue Sep 05, 2006 8:01 pm
- Location: Australia
the OP is after a real time transaction system like those used in the banks. DS is good for batch processing not real time transactions.filename.txt wrote:John Smith wrote: And if it is a banking type transactions again don't use Datastage.
Can you please explain us why ? I didn't understand this point.
Sorry for the confusion.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
DataStage can be configured to support real-time applications, by exposing a job as a web service through ISD. An always-running, multi-instance job is capable of quickly processing the data sent to it by the caller (and sending data back to the caller).
There is probably insufficient "encryption in flight" in this approach to satisfy the security requirements of most banks, particularly now that the regulators are going to screw this down even tighter.
There is probably insufficient "encryption in flight" in this approach to satisfy the security requirements of most banks, particularly now that the regulators are going to screw this down even tighter.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Charter Member
- Posts: 193
- Joined: Tue Sep 05, 2006 8:01 pm
- Location: Australia
Here's the IBM web site on using Java for Real Time applications.
http://www.ibm.com/developerworks/java/library/j-rtj1/
I'd happy to be proven wrong but has anyone built any real-time systems for a bank using Datastage?
http://www.ibm.com/developerworks/java/library/j-rtj1/
I'd happy to be proven wrong but has anyone built any real-time systems for a bank using Datastage?
One of the things that has to be looked at carefully here is the specific real time data integration "use case" whose problem needs solving.
Everyone on this thread has said correct things. Would DataStage be used to "build" an entire real time banking system...to be the sole infrastructure of such a system? Nope. Not even close. Might there be a hoard of interfaces to (and from) such a system that could/should use DataStage as a feeder, transformer, batch processor? Absolutely. It (DataStage) is only one piece of the puzzle, as in any environment. So many more details are needed, from target/source scenarios, different integration goals, users and support people, etc.
DataStage can provide real time transformations that are available to the rest of the enterprise and all other applications, and it can provide real time feeds from disparate systems, and it can, when necessary, perform units of work across different tables....but there are pros and cons for using it for each of those things, and technical and non technical variables that impact whether it makes sense in one environment or another.
DataStage has a complementary role to play in any data integration environment --- sometimes for nothing but "real time" purposes......but those purposes and goals have to be qualified with a lot more detail than any of us have heard here.
Ernie
Everyone on this thread has said correct things. Would DataStage be used to "build" an entire real time banking system...to be the sole infrastructure of such a system? Nope. Not even close. Might there be a hoard of interfaces to (and from) such a system that could/should use DataStage as a feeder, transformer, batch processor? Absolutely. It (DataStage) is only one piece of the puzzle, as in any environment. So many more details are needed, from target/source scenarios, different integration goals, users and support people, etc.
DataStage can provide real time transformations that are available to the rest of the enterprise and all other applications, and it can provide real time feeds from disparate systems, and it can, when necessary, perform units of work across different tables....but there are pros and cons for using it for each of those things, and technical and non technical variables that impact whether it makes sense in one environment or another.
DataStage has a complementary role to play in any data integration environment --- sometimes for nothing but "real time" purposes......but those purposes and goals have to be qualified with a lot more detail than any of us have heard here.
Ernie
Ernie Ostic
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>