Wavelet convolutions for large receptive fields

SE Finder, R Amoyal, E Treister, O Freifeld - European Conference on …, 2024 - Springer
In recent years, there have been attempts to increase the kernel size of Convolutional
Neural Nets (CNNs) to mimic the global receptive field of Vision Transformers'(ViTs) self …

Trainable highly-expressive activation functions

I Chelly, SE Finder, S Ifergane, O Freifeld - European Conference on …, 2024 - Springer
Nonlinear activation functions are pivotal to the success of deep neural nets, and choosing
the appropriate activation function can significantly affect their performance. Most networks …

TS3Net: Triple decomposition with spectrum gradient for long-term time series analysis

X Ma, X Hong, S Lu, W Li - 2024 IEEE 40th International …, 2024 - ieeexplore.ieee.org
Time series analysis has a wide range of applications in the fields of weather forecasting,
traffic management, fault detection, intelligent operation, etc. In the real world, time series …

Searching for n: M fine-grained sparsity of weights and activations in neural networks

R Akiva-Hochman, SE Finder, JS Turek… - European Conference on …, 2022 - Springer
Sparsity in deep neural networks has been extensively studied to compress and accelerate
models for environments with limited resources. The general approach of pruning aims at …

A framework for collaborative multi-robot map** using spectral graph wavelets

L Bernreiter, S Khattak, L Ott… - … Journal of Robotics …, 2024 - journals.sagepub.com
The exploration of large-scale unknown environments can benefit from the deployment of
multiple robots for collaborative map**. Each robot explores a section of the environment …

MagNet: Multilevel Dynamic Wavelet Graph Neural Network for Multivariate Time Series Classification

X Hong, J Hu, T Xu, X Ren, F Wu, X Ma… - ACM Transactions on …, 2024 - dl.acm.org
Multivariate Time Series Classification (MTSC) is a fundamental data mining task, which is
widely applied in the fields like health care and energy management. However, the existing …

Multiscale Training of Convolutional Neural Networks

N Zakariaei, S Ahamed, E Haber, M Eliasof - arxiv preprint arxiv …, 2025 - arxiv.org
Convolutional Neural Networks (CNNs) are the backbone of many deep learning methods,
but optimizing them remains computationally expensive. To address this, we explore …

Activation Map Compression through Tensor Decomposition for Deep Learning

LT Nguyen, A Quélennec, E Tartaglione… - arxiv preprint arxiv …, 2024 - arxiv.org
Internet of Things and Deep Learning are synergetically and exponentially growing
industrial fields with a massive call for their unification into a common framework called …

ASC: Adaptive Scale Feature Map Compression for Deep Neural Network

Y Yao, TS Chang - IEEE Transactions on Circuits and Systems I …, 2023 - ieeexplore.ieee.org
Deep-learning accelerators are increasingly in demand; however, their performance is
constrained by the size of the feature map, leading to high bandwidth requirements and …

A Wave is Worth 100 Words: Investigating Cross-Domain Transferability in Time Series

X Ma, X Hong, W Li, S Lu - arxiv preprint arxiv:2412.00772, 2024 - arxiv.org
Time series analysis is a fundamental data mining task that supervised training methods
based on empirical risk minimization have proven their effectiveness on specific tasks and …