Tensor methods in computer vision and deep learning

Y Panagakis, J Kossaifi, GG Chrysos… - Proceedings of the …, 2021 - ieeexplore.ieee.org
Tensors, or multidimensional arrays, are data structures that can naturally represent visual
data of multiple dimensions. Inherently able to efficiently capture structured, latent semantic …

Stable low-rank tensor decomposition for compression of convolutional neural network

AH Phan, K Sobolev, K Sozykin, D Ermilov… - Computer Vision–ECCV …, 2020 - Springer
Most state-of-the-art deep neural networks are overparameterized and exhibit a high
computational cost. A straightforward approach to this problem is to replace convolutional …

Xnor-net++: Improved binary neural networks

A Bulat, G Tzimiropoulos - arxiv preprint arxiv:1909.13863, 2019 - arxiv.org
This paper proposes an improved training algorithm for binary neural networks in which both
weights and activations are binary numbers. A key but fairly overlooked feature of the current …

Convolutional tensor-train LSTM for spatio-temporal learning

J Su, W Byeon, J Kossaifi, F Huang… - Advances in …, 2020 - proceedings.neurips.cc
Learning from spatio-temporal data has numerous applications such as human-behavior
analysis, object tracking, video compression, and physics simulation. However, existing …

Quantum convolutional neural network for image classification

G Chen, Q Chen, S Long, W Zhu, Z Yuan… - Pattern Analysis and …, 2023 - Springer
In this paper we propose two scale-inspired local feature extraction methods based on
Quantum Convolutional Neural Network (QCNN) in the Tensorflow quantum framework for …

Reusing pretrained models by multi-linear operators for efficient training

Y Pan, Y Yuan, Y Yin, Z Xu, L Shang… - Advances in Neural …, 2023 - proceedings.neurips.cc
Training large models from scratch usually costs a substantial amount of resources. Towards
this problem, recent studies such as bert2BERT and LiGO have reused small pretrained …

A survey of model compression strategies for object detection

Z Lyu, T Yu, F Pan, Y Zhang, J Luo, D Zhang… - Multimedia tools and …, 2024 - Springer
Deep neural networks (DNNs) have achieved great success in many object detection tasks.
However, such DNNS-based large object detection models are generally computationally …

Toward communication-efficient federated learning in the Internet of Things with edge computing

H Sun, S Li, FR Yu, Q Qi, J Wang… - IEEE Internet of Things …, 2020 - ieeexplore.ieee.org
Federated learning is an emerging concept that trains the machine learning models with the
local distributed data sets, without sending the raw data to the data center. But, in the …

Tensor networks meet neural networks: A survey and future perspectives

M Wang, Y Pan, Z Xu, X Yang, G Li… - arxiv preprint arxiv …, 2023 - arxiv.org
Tensor networks (TNs) and neural networks (NNs) are two fundamental data modeling
approaches. TNs were introduced to solve the curse of dimensionality in large-scale tensors …

Yonet: A neural network for yoga pose classification

FB Ashraf, MU Islam, MR Kabir, J Uddin - SN Computer Science, 2023 - Springer
Yoga has become an integral part of human life to maintain a healthy body and mind in
recent times. With the growing, fast-paced life and work from home, it has become difficult for …