Hardware Lecture Notes
Notes on Parallel Computer Architecture
Contents
Principles of Parallel Computing
Parallel Machines and Programming Models
Shared Memory Architecture
Distributed Memory Architecture
SIMD Architecture
Tradeoffs: Shared Memory vs. Distributed Memory Architecture
Nonuniform Memory Access in the context of Shared Memory Architecture
Cache Coherence in the context of Shared Memory Architecture
Memory Consistency in the context of Shared Memory Architecture
Examples of Distributed Memory Architecture
Examples of Message Passing Architecture
Cluster Computing
Scientific Supercomputing for Performance
Saleh Elmohamed, saleh@npac.syr.edu
