IT-803 (D) Parallel Computing Notes
5 notes for Parallel Computing, unit by unit.
Notes for IT-803 (D)
- Unit 1 · Short notes Introduction The need for parallelism · Forms of parallelism (SISD, SIMD, MISD, MIMD) · Moore's Law and multi‑core processors · Fundamentals of parallel computers · Communication architectures · Message‑passing architecture
- Unit 2 · Short notes Large Cache Design Shared versus private caches · Centralized versus distributed shared caches · Snooping‑based cache‑coherence protocols · Directory‑based cache‑coherence protocols · Uniform Cache Access (UCA) · Non‑Uniform Cache Access (NUCA)
- Unit 3 · Short notes Graphics Processing Unit GPUs as parallel computers · Architecture of modern GPUs · Evolution of graphics pipelines · General‑purpose GPUs (GPGPUs) · Scalable GPU designs · Architectural characteristics of future GPU systems
- Unit 4 · Short notes Introduction to Parallel Programming Parallel programming strategies and mechanisms · Performance theory for parallel programs · Parallel programming patterns · Nesting pattern · Parallel control pattern · Parallel data‑management pattern
- Unit 5 · Short notes Parallel Programming Languages Distributed memory programming with MPI: trapezoidal rule, I/O handling, derived datatypes, collective communication · Shared memory programming with Pthreads: conditional variables, read‑write locks, cache handling · Shared memory programming with OpenMP: parallel for directives, loop scheduling, thread safety · CUDA programming: CUDA C kernels, thread management, constant memory, events, graphics interoperability, atomics, streams
More for IT-803 (D)
Other 8th semester IT subjects
- IT-801 Information Security
- IT-802 (A) Machine Learning
- IT-802 (B) Natural Language Processing
- IT-802 (C) Robotics
- IT-802 (D) Quantum Computing
- IT-803 (A) Blockchain Technology
- IT-803 (B) Human Computer Interaction
- IT-803 (C) Printing and Design