Read. Lecture notes on parallel scientific computing by Tao Yang (Sections 1-9) and the MPI tutorial by Peter Pacheco
Slides:
Introduction.
Programming issues.
MPI parallel progamming.
Parallel scientific algorithms (matrix multiplication).
Parallel scientific algorithms (linear system solving).
Additional info:
Chapters 2 and 7 of
Culler/Singh's book "Parallel Computer Architecture: A Hardware/Software approach".
MPI Homepage.
Read. Demmel's Lecture 2 and Lecture 14.
Slides: Slides based on Demmel's notes.
Additional info:
Chapter 5 of
Culler/Singh's book "Parallel Computer Architecture: A Hardware/Software approach".
Block-based LU factorization without pivoting
Netlib BLAS information
Netlib LAPACK information
LAPACK Users' Guide
A survey on parallel numerical linear algebra by Demmel/Heath/van der Vorst
Slides: Part I Part II Part III Part IV . Those slides were developed by Prof. Prith Banerjee at Northwestern Univ.
Read:
Parallel progamming on SGI machines.
Pthread information (examples/documents).
Additional info:
Chapters 5, 6, and 8 of
Culler/Singh's book "Parallel Computer Architecture: A Hardware/Software approach".
Slides:
Task scheduling .
Space/time efficient scheduling .
Read:
T. Yang and A. Gerasoulis.
DSC: Scheduling parallel tasks
on an unbounded number of processors,
IEEE
Transactions on Parallel and
Distributed Systems, Vol. 5, No. 9, 951-967, 1994.
C. Fu and T. Yang.
Space and Time Efficient Execution of
Parallel Irregular Computation.
in ACM SIGPLAN Symposium on Principles & Practice of Parallel
Programming, Las Vegas, June, 1997.
Additional info:
Subhlok's PPoPP'95 paper slides.
Slides of paper by Ramaswamy et.al.
Read:
Willebeek-LeMair and Reeves's survey paper in the CS240B Reader.
Slides .
Load balancing in clustered digital library/Web servers
Slides that
can only be printed . You cannot view those slides in screen.
Additional info:
A paper on
load balancing for DL server clusters in IEEE HPDC'98 (High Performance Distributed Computing)
The MIT Cilk homepage.
Dynamic
scheduling in the SWEB project .
Slides:
Slides on parallelizing compilers.
Slides on HPF.
Read:
M. Wolfe, High Performance Compilers for Parallel Computing,
Addison-Wesley, 1996. Chapters 2 and 7 are in the reader.
Chapter 7 of
Designing and Building Parallel Programs by I. Foster.
Additional info: HPF homepage.
Slides:
Slides on sparse matrices, solving ODE/PDE.
Slides based on Demmel's notes.
Read: Demmel, Lectures 11, 12, 13 (in the reader).
Additional information: A survey on parallel numerical linear algebra by Demmel/Heath/van der Vorst