Hi all,
I got a requirment where i need to design a solution for near real time data extraction.
My requirment is,i need to extract data from source and run my job in every 10 mints from 8:30AM to 10PM.
I am thinking to design a sequence with many loops and stop,reset it everyday at 10PM using script and retrigger it in morning.
I will appreciate if someone can give other solution.
best way to design near real time job/sequence
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 536
- Joined: Thu Oct 11, 2007 1:48 am
- Location: Bangalore
best way to design near real time job/sequence
Thanks
Prasoon
ETL Consultant
LinkedIn :- http://www.linkedin.com/profile/view?id ... ab_pro_top
Blog:- http://dsshar.blogspot.com/
Prasoon
ETL Consultant
LinkedIn :- http://www.linkedin.com/profile/view?id ... ab_pro_top
Blog:- http://dsshar.blogspot.com/
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Why? What's wrong with your solution? We implement almost exactly that scenario in that way (though it's a 15 minute interval), with the addition of a mechanism for notifying the sequence to stop (a file comes into existence).
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Premium Member
- Posts: 536
- Joined: Thu Oct 11, 2007 1:48 am
- Location: Bangalore
Thanks Ray,
My only concern with this solution is Job log,log will keep on appending for the sequence because it will run 80 times in one day in a loop and auto purge only works when sequence finishes,and in solution it will finishe at 10.
My only concern with this solution is Job log,log will keep on appending for the sequence because it will run 80 times in one day in a loop and auto purge only works when sequence finishes,and in solution it will finishe at 10.
Thanks
Prasoon
ETL Consultant
LinkedIn :- http://www.linkedin.com/profile/view?id ... ab_pro_top
Blog:- http://dsshar.blogspot.com/
Prasoon
ETL Consultant
LinkedIn :- http://www.linkedin.com/profile/view?id ... ab_pro_top
Blog:- http://dsshar.blogspot.com/
I've done something very similar with the "need to stop" polling for a file that Ray mentioned... but it was every 5 minutes. No problems with the sequence job's log. The job you run "80 times in one day" will have 80 opportunities a day to purge itself.
-craig
"You can never have too many knives" -- Logan Nine Fingers
"You can never have too many knives" -- Logan Nine Fingers