When does self-supervision help graph convolutional networks?

Y You, T Chen, Z Wang, Y Shen - … conference on machine …, 2020 - proceedings.mlr.press
Self-supervision as an emerging technique has been employed to train convolutional neural
networks (CNNs) for more transferrable, generalizable, and robust representation learning …

Fast Estimation of via Stochastic Lanczos Quadrature

S Ubaru, J Chen, Y Saad - SIAM Journal on Matrix Analysis and Applications, 2017 - SIAM
The problem of estimating the trace of matrix functions appears in applications ranging from
machine learning and scientific computing, to computational biology. This paper presents an …

Improved variants of the Hutch++ algorithm for trace estimation

D Persson, A Cortinovis, D Kressner - SIAM Journal on Matrix Analysis and …, 2022 - SIAM
This paper is concerned with two improved variants of the Hutch++ algorithm for estimating
the trace of a square matrix, implicitly given through matrix-vector products. Hutch++ …

Krylov-aware stochastic trace estimation

T Chen, E Hallman - SIAM Journal on Matrix Analysis and Applications, 2023 - SIAM
We introduce an algorithm for estimating the trace of a matrix function using implicit products
with a symmetric matrix. Existing methods for implicit trace estimation of a matrix function …

Approximating spectral sums of large-scale matrices using stochastic Chebyshev approximations

I Han, D Malioutov, H Avron, J Shin - SIAM Journal on Scientific Computing, 2017 - SIAM
Computation of the trace of a matrix function plays an important role in many scientific
computing applications, including applications in machine learning, computational physics …

Deflation as a method of variance reduction for estimating the trace of a matrix inverse

AS Gambhir, A Stathopoulos, K Orginos - SIAM Journal on Scientific …, 2017 - SIAM
Many fields require computing the trace of the inverse of a large, sparse matrix. Since dense
matrix methods are not practical, the typical method used for such computations is the …

Primme_svds: A high-performance preconditioned svd solver for accurate large-scale computations

L Wu, E Romero, A Stathopoulos - SIAM Journal on Scientific Computing, 2017 - SIAM
The increasing number of applications requiring the solution of large-scale singular value
problems has rekindled an interest in iterative methods for the SVD. Some promising recent …

Distributed estimation of the inverse hessian by determinantal averaging

M Derezinski, MW Mahoney - Advances in Neural …, 2019 - proceedings.neurips.cc
Distributed estimation of the inverse Hessian by determinantal averaging Page 1
Distributed estimation of the inverse Hessian by determinantal averaging Michał Derezinski …

Spectrum approximation beyond fast matrix multiplication: Algorithms and hardness

C Musco, P Netrapalli, A Sidford, S Ubaru… - arxiv preprint arxiv …, 2017 - arxiv.org
Understanding the singular value spectrum of a matrix $ A\in\mathbb {R}^{n\times n} $ is a
fundamental task in countless applications. In matrix multiplication time, it is possible to …

Applications of trace estimation techniques

S Ubaru, Y Saad - … Conference on High Performance Computing in …, 2017 - Springer
We discuss various applications of trace estimation techniques for evaluating functions of
the form tr (f (A)) where f is certain function. The first problem we consider that can be cast in …