Skip to content
CampusPrep
CS-802 (C) · High Performance computing/Official Syllabus

High Performance computing (CS-802 (C)) - Official Syllabus

1
Unit 1

Introduction to modern processors

  • General Purpose cache based architecture
  • performance metric and bench marks
  • Moors Law
  • pipelining
  • super clarity
  • SIMD
  • Memory Hierarchies
  • Multi core processors
  • Multi threaded processors
  • Vector processors- Design principle
  • Max performance estimates
  • programming for vector architecture
  • Scalar profiling
  • common sense optimizations
  • Simple measures and their impacts
  • role of compilers
  • C++ optimizations
2
Unit 2

Data access optimizations

  • balance analysis and light speed estimates
  • storage order
  • Algorithm classifications and assess optimizations
  • case studies for data access optimizations
  • Shared memory computers
  • Distributed memory computers
  • hybrid systems
  • Network computers
3
Unit 3

Basics of parallel computing

  • data and functional parallelism
  • parallel scalability- laws
  • metrics
  • factors, efficiency and load imbalance
  • Shared memory parallel programming with Open MP
  • Parallel execution
  • data scoping
  • work sharing using loops
  • synchronization
  • Reductions
  • loop scheduling and Tasking
4
Unit 4

Efficient Open MP Programming

  • Program profiling
  • Performance pitfalls
  • improving the impact of open MP work sharing constructs
  • determining overheads for short loops
  • Serilisation and false sharing
5
Unit 5

Distributed Memory parallel programming with MPI

  • Message passing
  • Message and point to point communication
  • collective communication
  • non blocking point-to-point communication
  • virtual topologies
  • MPI performance tools
  • communication parameters
  • impact of synchronizations sterilizations and contentions
  • reductions in communication overhead

Reference Books

  • Introduction to high performance Computing for scientists and engineers — George Hager, Gerhard Wellein
  • High Performance Computing — Charles Severance, Kevin Dowd
Go to where you left off?

Quick Add to Notes

Save questions, your own notes and screenshots into notes filed by unit. It takes a free account.

Create free account

Have an account? Log in