Communication lower bounds and optimal algorithms for numerical linear algebra

G Ballard, E Carson, J Demmel, M Hoemmen… - Acta Numerica, 2014 - cambridge.org
The traditional metric for the efficiency of a numerical algorithm has been the number of
arithmetic operations it performs. Technological trends have long been reducing the time to …

GMRES algorithms over 35 years

Q Zou - Applied Mathematics and Computation, 2023 - Elsevier
This paper is about GMRES algorithms for the solution of nonsingular linear systems. We
first consider basic algorithms and study their convergence. We then focus on acceleration …

[BOG][B] Communication-avoiding Krylov subspace methods

M Hoemmen - 2010 - search.proquest.com
Krylov subspace methods (KSMs) are iterative algorithms for solving large, sparse linear
systems and eigenvalue problems. Current KSMs rely on sparse matrix-vector multiply …

Minimizing communication in sparse matrix solvers

M Mohiyuddin, M Hoemmen, J Demmel… - Proceedings of the …, 2009 - dl.acm.org
Data communication within the memory system of a single processor node and between
multiple nodes in a system is the bottleneck in many iterative sparse matrix solvers like CG …

Avoiding communication in sparse matrix computations

J Demmel, M Hoemmen… - … on Parallel and …, 2008 - ieeexplore.ieee.org
The performance of sparse iterative solvers is typically limited by sparse matrix-vector
multiplication, which is itself limited by memory system and network performance. As the gap …

[BOG][B] Communication-avoiding Krylov subspace methods in theory and practice

EC Carson - 2015 - search.proquest.com
Advancements in the field of high-performance scientific computing are necessary to
address the most important challenges we face in the 21st century. From physical modeling …

[BOG][B] Auto-tuning performance on multicore computers

SW Williams - 2008 - search.proquest.com
For the last decade, the exponential potential of Moore's Law has been squandered in the
effort to increase single thread performance, which is now limited by the memory, instruction …

Avoiding communication in nonsymmetric Lanczos-based Krylov subspace methods

E Carson, N Knight, J Demmel - SIAM Journal on Scientific Computing, 2013 - SIAM
Krylov subspace methods are iterative methods for solving large, sparse linear systems and
eigenvalue problems in a variety of scientific domains. On modern computer architectures …

Domain decomposition preconditioners for communication-avoiding Krylov methods on a hybrid CPU/GPU cluster

I Yamazaki, S Rajamanickam… - SC'14: Proceedings …, 2014 - ieeexplore.ieee.org
Krylov subspace projection methods are widely used iterative methods for solving large-
scale linear systems of equations. Researchers have demonstrated that communication …

A Residual Replacement Strategy for Improving the Maximum Attainable Accuracy of -Step Krylov Subspace Methods

E Carson, J Demmel - SIAM Journal on Matrix Analysis and Applications, 2014 - SIAM
Krylov subspace methods are a popular class of iterative methods for solving linear systems
with large, sparse matrices. On modern computer architectures, both sequential and parallel …