A sampling-based method for tensor ring decomposition

OA Malik, S Becker - International conference on machine …, 2021 - proceedings.mlr.press
We propose a sampling-based method for computing the tensor ring (TR) decomposition of
a data tensor. The method uses leverage score sampled alternating least squares to fit the …

More efficient sampling for tensor decomposition with worst-case guarantees

OA Malik - International conference on machine learning, 2022 - proceedings.mlr.press
Recent papers have developed alternating least squares (ALS) methods for CP and tensor
ring decomposition with a per-iteration cost which is sublinear in the number of input tensor …

A novel rank selection scheme in tensor ring decomposition based on reinforcement learning for deep neural networks

Z Cheng, B Li, Y Fan, Y Bao - ICASSP 2020-2020 IEEE …, 2020 - ieeexplore.ieee.org
Tensor decomposition has been proved to be effective for solving many problems in signal
processing and machine learning [1]. Recently, tensor decomposition finds its advantage for …

Randomized algorithms for fast computation of low rank tensor ring model

S Ahmadi-Asl, A Cichocki, AH Phan… - Machine Learning …, 2020 - iopscience.iop.org
Randomized algorithms are efficient techniques for big data tensor analysis. In this tutorial
paper, we review and extend a variety of randomized algorithms for decomposing large …

Practical sketching‐based randomized tensor ring decomposition

Y Yu, H Li - Numerical Linear Algebra with Applications, 2024 - Wiley Online Library
Based on sketching techniques, we propose two practical randomized algorithms for tensor
ring (TR) decomposition. Specifically, on the basis of defining new tensor products and …

Smooth compact tensor ring regression

J Liu, C Zhu, Y Liu - IEEE Transactions on Knowledge and Data …, 2020 - ieeexplore.ieee.org
In learning tasks with high order correlations, the low-rank approximation of the regression
coefficient tensor has become increasingly important. Tensor ring can capture more …

Low-rank tensor ring learning for multi-linear regression

J Liu, C Zhu, Z Long, H Huang, Y Liu - Pattern Recognition, 2021 - Elsevier
The emergence of large-scale data demands new regression models with multi-dimensional
coefficient arrays, known as tensor regression models. The recently proposed tensor ring …

Tensor dropout for robust learning

A Kolbeinsson, J Kossaifi, Y Panagakis… - IEEE Journal of …, 2021 - ieeexplore.ieee.org
CNNs achieve high levels of performance by leveraging deep, over-parametrized neural
architectures, trained on large datasets. However, they exhibit limited generalization abilities …

A randomized block Krylov method for tensor train approximation

G Yu, J Feng, Z Chen, X Cai, L Qi - arxiv preprint arxiv:2308.01480, 2023 - arxiv.org
Tensor train decomposition is a powerful tool for dealing with high-dimensional, large-scale
tensor data, which is not suffering from the curse of dimensionality. To accelerate the …

SVD-based algorithms for tensor wheel decomposition

M Wang, H Cui, H Li - Advances in Computational Mathematics, 2024 - Springer
Tensor wheel (TW) decomposition combines the popular tensor ring and fully connected
tensor network decompositions and has achieved excellent performance in tensor …