I wanted to know about sequence performance.
Here I am having 100 plus small sequences that are having 4 - 5 jobs incorporated in each on an avg. Now these sub sequences are to be called in one master sequence which represents a Single Database.
What can be the best approach for moving forward: -
1.I should split this in 4 - 5 (sub master)sequences where in each of these I'll call 25 small subsequences. Later I'll incorporate these 4 - 5 sub master sequences in a single sequence.
2.I should directly go ahead and call all these 100 subsequences in a single sequence. But I think this will be more complicated and it will be more difficult to track and debug any error in it.
Sequence Performance Query
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 221
- Joined: Fri Feb 17, 2006 3:38 am
- Location: India
- Contact:
Sequence Performance Query
Thanks & Regards
Parag Saundattikar
Certified for Infosphere DataStage v8.0
Parag Saundattikar
Certified for Infosphere DataStage v8.0
-
- Participant
- Posts: 612
- Joined: Thu May 03, 2007 4:59 am
- Location: Melbourne
Modularizing and putting comments for log entries is for sure the best way. Option 2.
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
You will also need to take into consideration that if you are firing these many jobs at the same time, CPU might run out of processing power and starts crapping out. (need to take hardware into consideration). Also logging information into the job log can be done by calling a custom routine that does that(in this routin you can put a DS log command)
-
- Participant
- Posts: 221
- Joined: Fri Feb 17, 2006 3:38 am
- Location: India
- Contact:
The Hardware is selected as per the requirements only...hence it is fully compatible.abhi989 wrote:You will also need to take into consideration that if you are firing these many jobs at the same time, CPU might run out of processing power and starts crapping out. (need to take hardware into consideration). Also logging information into the job log can be done by calling a custom routine that does that(in this routin you can put a DS log command)
Thanks & Regards
Parag Saundattikar
Certified for Infosphere DataStage v8.0
Parag Saundattikar
Certified for Infosphere DataStage v8.0
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: