A primer on motion capture with deep learning: principles, pitfalls, and perspectives

A Mathis, S Schneider, J Lauer, MW Mathis - Neuron, 2020 - cell.com
Extracting behavioral measurements non-invasively from video is stymied by the fact that it is
a hard computational problem. Recent advances in deep learning have tremendously …

Dense contrastive learning for self-supervised visual pre-training

X Wang, R Zhang, C Shen… - Proceedings of the …, 2021 - openaccess.thecvf.com
To date, most existing self-supervised learning methods are designed and optimized for
image classification. These pre-trained models can be sub-optimal for dense prediction …

Rethinking pre-training and self-training

B Zoph, G Ghiasi, TY Lin, Y Cui, H Liu… - Advances in neural …, 2020 - proceedings.neurips.cc
Pre-training is a dominant paradigm in computer vision. For example, supervised ImageNet
pre-training is commonly used to initialize the backbones of object detection and …

Multi-task self-training for learning general representations

G Ghiasi, B Zoph, ED Cubuk… - Proceedings of the …, 2021 - openaccess.thecvf.com
Despite the fast progress in training specialized models for various tasks, learning a single
general model that works well for many tasks is still challenging for computer vision. Here …

On warm-starting neural network training

J Ash, RP Adams - Advances in neural information …, 2020 - proceedings.neurips.cc
In many real-world deployments of machine learning systems, data arrive piecemeal. These
learning scenarios may be passive, where data arrive incrementally due to structural …

Pretraining boosts out-of-domain robustness for pose estimation

A Mathis, T Biasi, S Schneider… - Proceedings of the …, 2021 - openaccess.thecvf.com
Neural networks are highly effective tools for pose estimation. However, as in other
computer vision tasks, robustness to out-of-domain data remains a challenge, especially for …

A Survey of incremental deep learning for defect detection in manufacturing

R Mohandas, M Southern, E O'Connell… - Big Data and Cognitive …, 2024 - mdpi.com
Deep learning based visual cognition has greatly improved the accuracy of defect detection,
reducing processing times and increasing product throughput across a variety of …

Gaia: A transfer learning system of object detection that fits your needs

X Bu, J Peng, J Yan, T Tan… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Transfer learning with pre-training on large-scale datasets has played an increasingly
significant role in computer vision and natural language processing recently. However, as …

Neural data server: A large-scale search engine for transfer learning data

X Yan, D Acuna, S Fidler - … of the IEEE/CVF Conference on …, 2020 - openaccess.thecvf.com
Transfer learning has proven to be a successful technique to train deep learning models in
the domains where little training data is available. The dominant approach is to pretrain a …

Exploring visual interpretability for contrastive language-image pre-training

Y Li, H Wang, Y Duan, H Xu, X Li - arxiv preprint arxiv:2209.07046, 2022 - arxiv.org
Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily
available supervision of natural language. It improves the performance of downstream vision …