Wavelet convolutions for large receptive fields
In recent years, there have been attempts to increase the kernel size of Convolutional
Neural Nets (CNNs) to mimic the global receptive field of Vision Transformers'(ViTs) self …
Neural Nets (CNNs) to mimic the global receptive field of Vision Transformers'(ViTs) self …
Trainable highly-expressive activation functions
Nonlinear activation functions are pivotal to the success of deep neural nets, and choosing
the appropriate activation function can significantly affect their performance. Most networks …
the appropriate activation function can significantly affect their performance. Most networks …
TS3Net: Triple decomposition with spectrum gradient for long-term time series analysis
Time series analysis has a wide range of applications in the fields of weather forecasting,
traffic management, fault detection, intelligent operation, etc. In the real world, time series …
traffic management, fault detection, intelligent operation, etc. In the real world, time series …
Searching for n: M fine-grained sparsity of weights and activations in neural networks
Sparsity in deep neural networks has been extensively studied to compress and accelerate
models for environments with limited resources. The general approach of pruning aims at …
models for environments with limited resources. The general approach of pruning aims at …
A framework for collaborative multi-robot map** using spectral graph wavelets
The exploration of large-scale unknown environments can benefit from the deployment of
multiple robots for collaborative map**. Each robot explores a section of the environment …
multiple robots for collaborative map**. Each robot explores a section of the environment …
MagNet: Multilevel Dynamic Wavelet Graph Neural Network for Multivariate Time Series Classification
X Hong, J Hu, T Xu, X Ren, F Wu, X Ma… - ACM Transactions on …, 2024 - dl.acm.org
Multivariate Time Series Classification (MTSC) is a fundamental data mining task, which is
widely applied in the fields like health care and energy management. However, the existing …
widely applied in the fields like health care and energy management. However, the existing …
Multiscale Training of Convolutional Neural Networks
Convolutional Neural Networks (CNNs) are the backbone of many deep learning methods,
but optimizing them remains computationally expensive. To address this, we explore …
but optimizing them remains computationally expensive. To address this, we explore …
Activation Map Compression through Tensor Decomposition for Deep Learning
Internet of Things and Deep Learning are synergetically and exponentially growing
industrial fields with a massive call for their unification into a common framework called …
industrial fields with a massive call for their unification into a common framework called …
ASC: Adaptive Scale Feature Map Compression for Deep Neural Network
Y Yao, TS Chang - IEEE Transactions on Circuits and Systems I …, 2023 - ieeexplore.ieee.org
Deep-learning accelerators are increasingly in demand; however, their performance is
constrained by the size of the feature map, leading to high bandwidth requirements and …
constrained by the size of the feature map, leading to high bandwidth requirements and …
A Wave is Worth 100 Words: Investigating Cross-Domain Transferability in Time Series
X Ma, X Hong, W Li, S Lu - arxiv preprint arxiv:2412.00772, 2024 - arxiv.org
Time series analysis is a fundamental data mining task that supervised training methods
based on empirical risk minimization have proven their effectiveness on specific tasks and …
based on empirical risk minimization have proven their effectiveness on specific tasks and …