Dynamic load balancing

R. D. Williams. Performance of dynamic load balancing algorithms for... 

F. Bruge and S. L. Fornili, Comput. Phys. Commun., 60, 39 (1990). A Distributed Dynamic Load Balancer and Its Implementation on Multi-Transputer Systems for Molecular Dynamics Simulation. 

Parallel Implementation Using Dynamic Load Balancing... 

In summary, we have here analyzed the performance of a dynamic manager-worker model for disfribufing shell pairs in the parallel computation of fwo-elecfron infegrals. The analysis clearly demonsfrafes fhat the dynamic distribution of shell pairs provides significanfly higher parallel efficiency than the static shell pair distribution, except for very small process counts, and that dynamic load balancing enables utilization of a large number of processes with little loss of efficiency... 

Adaptive, dynamically load balancing computations, as the extent of elastic and elastic-plastic domains changes dynamically and unpredictably during the course of the computation. 

FIGURE 11 Simulation of a Mach 3 flow over a step showing fluid velocity, density, and pressure. This was done for a 32-processor parallel computer with dynamical load balancing shown by thick solid lines in the top diagram. 

Two different strategies may be employed to partition the work among processors. The first approach, dynamic load balancing, often uses a master-slave model where one processor, the master, keeps a list of tasks to be executed and apportions these tasks to the other processors, the slaves (the master may be a slave as well). When a processor has completed a task, it reports back to the master and requests a new task. This dynamic task allocation requires interprocessor communication, but has the advantage that load balance may be obtained even for problems where the execution time for individual tasks is variable and not known in advance. 

---