This article is cited in 6 papers

Survey of parallel computation models

N. A. Ezhova, L. B. Sokolinskii

South Ural State University (pr. Lenina 76, Chelyabinsk, 454080 Russia)

Abstract: This survey aims to present the state of the art in analytic parallel computation models, providing sufficiently detailed descriptions of particularly noteworthy efforts. Such models allow predicting the computation time, speedup, efficiency and scalability of parallel algorithms for various target multiprocessor platforms. Modeling the cost of computations and communications in multiprocessor systems is an important and challenging problem. It provides insights into the design of the parallel algorithms for optimization of their deployment in the increasingly complex high-performance computing. The survey shows the evolution of parallel computing models inspired by the evolution of multiprocessor systems, from single-level models with shared memory to multi-level hierarchical models with distributed memory, which correspond to multicore clusters. The review concludes with prospective directions for further research in the area of developing mathematical models for parallel computing.

Keywords: computing model, survey, parallel programming, multiprocessor systems, performance evaluation, execution time prediction.

UDC: 004.051

Received: 01.06.2019

DOI: 10.14529/cmse190304

Bibliographic databases:

•