Tensor methods in computer vision and deep learning

Y Panagakis, J Kossaifi, GG Chrysos… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Tensors, or multidimensional arrays, are data structures that can naturally represent visual
data of multiple dimensions. Inherently able to efficiently capture structured, latent semantic …

Tensorly: Tensor learning in python

J Kossaifi, Y Panagakis, A Anandkumar… - Journal of Machine …, 2019 - jmlr.org
Tensors are higher-order extensions of matrices. While matrix methods form the cornerstone
of traditional machine learning and data analysis, tensor methods have been gaining …

Tensor regression networks

J Kossaifi, ZC Lipton, A Kolbeinsson, A Khanna… - Journal of Machine …, 2020 - jmlr.org
Convolutional neural networks typically consist of many convolutional layers followed by
one or more fully connected layers. While convolutional layers map between high-order …

Low-rank tucker decomposition of large tensors using tensorsketch

OA Malik, S Becker - Advances in neural information …, 2018 - proceedings.neurips.cc
We propose two randomized algorithms for low-rank Tucker decomposition of tensors. The
algorithms, which incorporate sketching, only require a single pass of the input tensor and …

High performance zero-memory overhead direct convolutions

J Zhang, F Franchetti, TM Low - International Conference on …, 2018 - proceedings.mlr.press
The computation of convolution layers in deep neural networks typically rely on high
performance routines that trade space for time by using additional memory (either for …

Acceleration of tensor-product operations for high-order finite element methods

K Świrydowicz, N Chalmers… - … Journal of High …, 2019 - journals.sagepub.com
This article is devoted to graphics processing unit (GPU) kernel optimization and
performance analysis of three tensor-product operations arising in finite element methods …

Tensor contraction layers for parsimonious deep nets

J Kossaifi, A Khanna, Z Lipton… - Proceedings of the …, 2017 - openaccess.thecvf.com
Tensors offer a natural representation for many kinds of data frequently encountered in
machine learning. Images, for example, are naturally represented as third order tensors …

Tensor networks for lattice gauge theories beyond one dimension: a roadmap

G Magnifico, G Cataldi, M Rigobello, P Majcen… - arxiv preprint arxiv …, 2024 - arxiv.org
Tensor network methods are a class of numerical tools and algorithms to study many-body
quantum systems in and out of equilibrium, based on tailored variational wave functions …

Sparta: High-performance, element-wise sparse tensor contraction on heterogeneous memory

J Liu, J Ren, R Gioiosa, D Li, J Li - … on Principles and Practice of Parallel …, 2021 - dl.acm.org
Sparse tensor contractions appear commonly in many applications. Efficiently computing a
two sparse tensor product is challenging: It not only inherits the challenges from common …

GPU-acceleration of tensor renormalization with PyTorch using CUDA

RG Jha, A Samlodia - Computer Physics Communications, 2024 - Elsevier
We show that numerical computations based on tensor renormalization group (TRG)
methods can be significantly accelerated with PyTorch on graphics processing units (GPUs) …