A survey of accelerating parallel sparse linear algebra

G **ao, C Yin, T Zhou, X Li, Y Chen, K Li - ACM Computing Surveys, 2023 - dl.acm.org
Sparse linear algebra includes the fundamental and important operations in various large-
scale scientific computing and real-world applications. There exists performance bottleneck …

Practical leverage-based sampling for low-rank tensor decomposition

BW Larsen, TG Kolda - SIAM Journal on Matrix Analysis and Applications, 2022 - SIAM
The low-rank canonical polyadic tensor decomposition is useful in data analysis and can be
computed by solving a sequence of overdetermined least squares subproblems. Motivated …

A sampling-based method for tensor ring decomposition

OA Malik, S Becker - International conference on machine …, 2021 - proceedings.mlr.press
We propose a sampling-based method for computing the tensor ring (TR) decomposition of
a data tensor. The method uses leverage score sampled alternating least squares to fit the …

More efficient sampling for tensor decomposition with worst-case guarantees

OA Malik - International conference on machine learning, 2022 - proceedings.mlr.press
Recent papers have developed alternating least squares (ALS) methods for CP and tensor
ring decomposition with a per-iteration cost which is sublinear in the number of input tensor …

aeSpTV: An adaptive and efficient framework for sparse tensor-vector product kernel on a high-performance computing platform

Y Chen, G **ao, MT Özsu, C Liu… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Multi-dimensional, large-scale, and sparse data, which can be neatly represented by sparse
tensors, are increasingly used in various applications such as data analysis and machine …

Efficient Utilization of Multi-Threading Parallelism on Heterogeneous Systems for Sparse Tensor Contraction

G **ao, C Yin, Y Chen, M Duan… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Many fields of scientific simulation, such as chemistry and condensed matter physics, are
increasingly eschewing dense tensor contraction in favor of sparse tensor contraction. In this …

Fast randomized matrix and tensor interpolative decomposition using CountSketch

OA Malik, S Becker - Advances in Computational Mathematics, 2020 - Springer
We propose a new fast randomized algorithm for interpolative decomposition of matrices
which utilizes CountSketch. We then extend this approach to the tensor interpolative …

Adaptive sketching for fast and convergent canonical polyadic decomposition

A Gittens, K Aggour, B Yener - International Conference on …, 2020 - proceedings.mlr.press
This work considers the canonical polyadic decomposition (CPD) of tensors using
proximally regularized sketched alternating least squares algorithms. First, it establishes a …

SSMF: shifting seasonal matrix factorization

K Kawabata, S Bhatia, R Liu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Given taxi-ride counts information between departure and destination locations, how can we
forecast their future demands? In general, given a data stream of events with seasonal …

Higher-order count sketch: dimensionality reduction that retains efficient tensor operations

Y Shi, A Anandkumar - arxiv preprint arxiv:1901.11261, 2019 - arxiv.org
Sketching is a randomized dimensionality-reduction method that aims to preserve relevant
information in large-scale datasets. Count sketch is a simple popular sketch which uses a …