- Weeks 1-2: Introduction. Memory hierarchy
Introduction to Parallel and High Performance Computing
Parallel Architectures and Performance
Caches and memory hierarchy
Part I ,
Part II,
Part III
Intel SIMD programming
( ppt, pdf)
Additional reference:
Chapter 2 of Book Introduction to Parallel Programming by
Peter Pacheco.
Homework 1
- Weeks 3-4: Shared and Distributed Memory Programming
Pthreads
OpenMP (ppt, pdf)
MPI Part I, MPI Part II
Program Transformation I, II.
Additional references:
Pthreads,
OpenMP.
MPI.
Chapter 3 of Book Introduction to Parallel Programming by Peter Pacheco.
- Weeks 5-6: GPU, MapReduce, and Spark
GPU Programming I
Hadoop and MapReduce
Use MapReduce at Comet (pdf)
Spark. (Use Spark at Comet)
Additional references:
Homework 2. Hints for PageRank assignment
- Weeks 7-8: GPU and Machine Learning Applications
Advanced GPU Programming II, III
Parallel machine learning applications
- Weeks 9-10: Parallel Scientific Computing and Project
Presentation
Parallel methods for ODEs and PDEs