Parallel program design

To illustrate some of the parallel program design principles discussed in this chapter, let us consider the design of a parallel algorithm to perform a dense matrix-vector multiplication Ab = c, where A is an n x n matrix and b and c are n-dimensional vectors. To be able to take full advantage of the... 

This book is divided into two parts. In Part 1 we will discuss parallel computer architectures as well as parallel computing concepts and terminology with a focus on good parallel program design and performance... 

MOFPRO (we tested Version 98.1) is an ah initio program designed for performing complex calculations. This program is often used for calculations that present technical difficulties or are very sensitive to electron correlation. A few portions of the code have been parallelized. 

Artificial neural networks (ANNs) are computer programs designed to model the relationships between independent and dependent variables. They are based on the attempt to model the neural networks of the brain [50], Functions are performed collectively and in parallel by the units, rather than there being a clear delineation of subtasks to which various units are assigned. 

In designing a complex parallel program, it is useful to think of any parallel computer in terms of a NUMA model in which all memory, anywhere in the system, can be accessed by any processor as needed. One can then focus independently on the questions of memory access methods (which determine coding style for an application) and memory access costs (which ultimately determine program efficiency). 

The performance of a parallel program is important. If it were not, it would not make sense to go to the trouble and expense of parallelizing the program in the first place. Thus, parallel programs must first be designed so that good performance is possible, then coded to actually achieve that potential. 

Ab initio calculations for large organometallic and other compounds. FORTRAN programs designed for high performance vector and parallel processing machines. 

I. Foster, Designing and Building Parallel Programs Concepts and Tools for Parallel Software Engineering, Addison-Wesley, 1994. 

Sur, S., H.-W. Jin, L. Chai, and D. K. Panda. RDMA read based rendezvous protocol for MPI over InfiniBand Design alternatives and benefits. In Proceedings of the Eleventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pp. 32-39. New York ACM Press, 2006. 

Foster, I. Designing and building parallel programs [online]. http //www-unix.mcs.anl.gov/dbpp. 

---