Tentative Weekly References for CS140 (updated every week)

• Week 1: Introduction to Parallel Scientific Computing
  
  Slides: Introduction to CS 140
  Textbook Chapter 1
  • Get a class account in Triton by emailing your first/last name, UCSB email, and ssh public key with subject "CS140 ssh key" to scc@oit.ucsb.edu .
  • Discussion section: Useful tools. TSCC account. HW1.

• Week 2: Parallel Architectures, Software, and Computation Models

  Slides: Textbook Chapter 2
  Task graph computation model
  Common communication operations

  • Homework 1 (Ch 1 and 2. Due on April 15 before class).
  • Lecture notes on task graphs and communication operations (Sections 1 and 2)
  • Discussion section: TSCC demo. HW1.

• Week 3-4: Program Parallelization and Distributed-Memory Programming

  Slides: Textbook Chapter 3 Part I
  Program transformation for parallelization
  Textbook Chapter 3 Part II
  Case study: matrix computation in web search/mining

  • Login and resource allocation at TSCC
  • How to run an MPI program at TSCC
  • Homework 2 (Ch 3. Due on April 29 before class).
  • Discussion section: TSCC MPI demo. HW2.
  • Additional lecture notes on program parallelization and matrix multiplication (Sections 3 and 4)

• Weeks 5-6: Shared-Memory Programming with Pthreads

  Midterm review. Sample problems and solutions.

  Slides: Textbook Chapter 4 Part I . Part II .
  

  • Homework 3 (Ch 4. Due on May 13 before class).
  • Midterm (May 6).
  • Discussion section: TSCC Pthreads demo. HW1+HW2 review/HW3.
  • How to run a pthread program at TSCC

• Weeks 6-7: Parallel Program Development: Iterative Methods for Solving Equations

  Slides: Linear equations and PDEs

  • Homework 4a (Due on May 23 midnight).
  • Additional lecture notes on solving linear equations and PDEs (Sections 8 and 10.3)
  • Discussion section: TSCC Pthreads demo/HW3. Midterm review.

• Weeks 7-8: MapReduce Parallel Programming for Data-Intensive Computing

  Slides: MapReduce
  Hadoop/MapReduce at TSCC and HW4b

  • Homework HW4b (Mapreduce. Due on May 30, 11:59pm).
  • Tutorials on MapReduce, Hadoop/MapReduce. Short comments on wordcount example and more detailed explanation for an older version
  • Paper: MapReduce: Simplified Data Processing on Large Clusters Dean and Ghemawhat. OSDI 2004.
  • Discussion section: TSCC Mapreduce demo. HW4b.

• Week 9/10: Parallel Program Development: Tree Search

  Slides: Textbook Chapter 6 tree search
  

  • Discussion section: HW4.

• Week 10: Selected Topics and Review

  Slides: TBA
  Memory hierarchy and performance optimization
  Chapter 5 Shared-memory programming with OpenMP
  

  • Discussion section: Midterm/HW review.

• Final Exam: June 11 ( Wed, noon-3pm at North Hall 1111)