Are large kernels better teachers than transformers for convnets?
This paper reveals a new appeal of the recently emerged large-kernel Convolutional Neural
Networks (ConvNets): as the teacher in Knowledge Distillation (KD) for small-kernel …
Networks (ConvNets): as the teacher in Knowledge Distillation (KD) for small-kernel …
Continual learning with deep neural networks in physiological signal data: A survey
Deep-learning algorithms hold promise in processing physiological signal data, including
electrocardiograms (ECGs) and electroencephalograms (EEGs). However, healthcare often …
electrocardiograms (ECGs) and electroencephalograms (EEGs). However, healthcare often …
UniTS: A unified multi-task time series model
Although pre-trained transformers and reprogrammed text-based LLMs have shown strong
performance on time series tasks, the best-performing architectures vary widely across …
performance on time series tasks, the best-performing architectures vary widely across …
Units: Building a unified time series model
Foundation models, especially LLMs, are profoundly transforming deep learning. Instead of
training many task-specific models, we can adapt a single pretrained model to many tasks …
training many task-specific models, we can adapt a single pretrained model to many tasks …
Convtimenet: A deep hierarchical fully convolutional model for multivariate time series analysis
This paper introduces ConvTimeNet, a novel deep hierarchical fully convolutional network
designed to serve as a general-purpose model for time series analysis. The key design of …
designed to serve as a general-purpose model for time series analysis. The key design of …
Review of Time Series Classification Techniques and Methods
In order to spot trends in the methodologies and procedures employed, this systematic
literature review will look at works on time series categorization. Six research questions are …
literature review will look at works on time series categorization. Six research questions are …
Diversify: A General Framework for Time Series Out-of-distribution Detection and Generalization
Time series remains one of the most challenging modalities in machine learning research.
Out-of-distribution (OOD) detection and generalization on time series often face difficulties …
Out-of-distribution (OOD) detection and generalization on time series often face difficulties …
CNN kernels can be the best shapelets
Shapelets and CNN are two typical approaches to model time series. Shapelets aim at
finding a set of sub-sequences that extract feature-based interpretable shapes, but may …
finding a set of sub-sequences that extract feature-based interpretable shapes, but may …
Are Sparse Neural Networks Better Hard Sample Learners?
While deep learning has demonstrated impressive progress, it remains a daunting
challenge to learn from hard samples as these samples are usually noisy and intricate …
challenge to learn from hard samples as these samples are usually noisy and intricate …
TSec: An Efficient and Effective Framework for Time Series Classification
Time series classification assigns predefined labels or classes to sequences of data points
ordered chronologically, which is a fundamental task for time series analysis. Existing time …
ordered chronologically, which is a fundamental task for time series analysis. Existing time …