High Performance computing (CS-802 (C)) - Important Questions

Draw the block diagram of a typical cache-based microprocessor.

Differentiate multi-core, multithreaded and vector processors.

What is parallelism? Discuss the different variants of parallelism with the help of an example in each case.

Discuss C++ optimizations.

What do you mean by scalar profiling? Explain function and line-based profiling.

Explain the blocking and rolling strategies with the help of multiplication of a sparse matrix with a vector.

What is OpenMP? Explain the concepts of data scoping, work-sharing for loops and loop scheduling.

What is non-blocking point-to-point communication? How does it differ from blocking communication?

Discuss the performance problems that can be raised with OpenMP shared-memory programming, also discuss how they can be circumvented?

How to reduce the communication overhead? Differentiate non-blocking and asynchronous communication.

Draw the flowchart for distributed-memory parallelization of the Jacobi algorithm.

Write a short note on the following (any two).