Hello Forum,
What are the different factors that affect startup time. Trivial jobs that I create that have one input and one output file and one transform usually have a startup time of less than 5 seconds. However, trivial read of a table often results in startup times between 15-30 seconds.
Is this abnormal behavoir?
Thanks,
Greg
Factors affecting startup time?
Moderators: chulett, rschirm, roy
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
The obvious one is getting the section leader processes started and talking to the conductor processes. There are many potential variables here especially on a cluster of machines.
Connecting to database servers from multiple player processes also can take a lot of time. It's not just connection, it's also authentication, preparing SQL, and so on. These costs are worse in parallel execution simply because they have to occur N times.
Connecting to database servers from multiple player processes also can take a lot of time. It's not just connection, it's also authentication, preparing SQL, and so on. These costs are worse in parallel execution simply because they have to occur N times.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.