Parallel Computing (IT-803 (D)) - Important Questions

Distinguish among computer terminologies in each of the following groups: (a) Parallel vs Distributed vs Concurrent computing (b) SISD, SIMD, MISD, MIMD

Describe at least four characteristics of MIMD multiprocessors that distinguish them from multiple computer systems or computer networks.

Prove that a k-stage linear pipeline achieves at most k times speedup over a non-pipelined serial processor.

What are the disadvantages of a cache using virtual addresses?

Differentiate between: (a) Centralized vs Distributed shared caches (b) Snooping vs Directory-based coherence

Discuss the architecture of a modern GPU. Give its applications.

What is the difference between transaction and transactional memory? Explain briefly STM and HTM.

Discuss the architectural characteristics of future systems including scalable GPUs.

Briefly characterize the multicache coherence problem and describe various methods that have been suggested to cope with the problem.

Explain the scan operation in parallel programming with an example. What is meant by fusing map and scan? Discuss its advantage.

Explain distributed-memory programming with MPI with reference to trapezoidal rule in MPI.

Explain the performance metrics of a parallel system such as speedup, efficiency, cost and scalability.

Give a brief note on I/O handling in parallel programming languages including MPI derived datatypes.

Write brief notes on any two: (a) Parallel programming models (b) Principles of parallel algorithm design (c) Data-parallel vs Task-parallel model