High Performance computing (CS-802 (C)) - Important Questions

Write a short note on the following (Any two)

Draw the block diagram of a typical cache-based microprocessor.

Differentiate Multi-core, Multithreaded and Vector processors.

Discuss C++ optimizations.

What do you mean by scalar profiling? Explain function and line-based profiling.

Explain the blocking and rolling strategies with the help of multiplication of a sparse matrix with a vector.

Draw the flowchart for distributed-memory parallelization of the Jacobi algorithm.

What is Parallelism? Discuss the different variants of parallelism with the help of an example in each case.

What is OpenMP? Explain the concepts of data scoping, work-sharing for loops and loop scheduling.

Discuss the performance problems that can be raised with OpenMP shared-memory programming, also discuss how they can be circumvented?

What is non-blocking point-to-point communication? How it differs from blocking communication?

How to reduce the communication overhead? Differentiate non-blocking and asynchronous communication.