Are deep neural networks adequate behavioral models of human visual perception?

FA Wichmann, R Geirhos - Annual review of vision science, 2023 - annualreviews.org
Deep neural networks (DNNs) are machine learning algorithms that have revolutionized
computer vision due to their remarkable successes in tasks like object classification and …

The effectiveness of mae pre-pretraining for billion-scale pretraining

M Singh, Q Duval, KV Alwala, H Fan… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper revisits the standard pretrain-then-finetune paradigm used in computer vision for
visual recognition tasks. Typically, state-of-the-art foundation models are pretrained using …

Facet: Fairness in computer vision evaluation benchmark

L Gustafson, C Rolland, N Ravi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Computer vision models have known performance disparities across attributes such as
gender and skin tone. This means during tasks such as classification and detection, model …

A closer look at the robustness of contrastive language-image pre-training (clip)

W Tu, W Deng, T Gedeon - Advances in Neural Information …, 2023 - proceedings.neurips.cc
Abstract Contrastive Language-Image Pre-training (CLIP) models have demonstrated
remarkable generalization capabilities across multiple challenging distribution shifts …

A whac-a-mole dilemma: Shortcuts come in multiples where mitigating one amplifies others

Z Li, I Evtimov, A Gordo, C Hazirbas… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Machine learning models have been found to learn shortcuts---unintended decision
rules that are unable to generalize---undermining models' reliability. Previous works address …

Effective human-AI teams via learned natural language rules and onboarding

H Mozannar, J Lee, D Wei, P Sattigeri… - Advances in …, 2023 - proceedings.neurips.cc
People are relying on AI agents to assist them with various tasks. The human must know
when to rely on the agent, collaborate with the agent, or ignore its suggestions. In this work …

Identification of systematic errors of image classifiers on rare subgroups

JH Metzen, R Hutmacher, NG Hua… - Proceedings of the …, 2023 - openaccess.thecvf.com
Despite excellent average-case performance of many image classifiers, their performance
can substantially deteriorate on semantically coherent subgroups of the data that were …

Understanding the detrimental class-level effects of data augmentation

P Kirichenko, M Ibrahim, R Balestriero… - Advances in …, 2023 - proceedings.neurips.cc
Data augmentation (DA) encodes invariance and provides implicit regularization critical to a
model's performance in image classification tasks. However, while DA improves average …

Pug: Photorealistic and semantically controllable synthetic data for representation learning

F Bordes, S Shekhar, M Ibrahim… - Advances in …, 2023 - proceedings.neurips.cc
Synthetic image datasets offer unmatched advantages for designing and evaluating deep
neural networks: they make it possible to (i) render as many data samples as needed,(ii) …

Explore and exploit the diverse knowledge in model zoo for domain generalization

Y Chen, T Hu, F Zhou, Z Li… - … Conference on Machine …, 2023 - proceedings.mlr.press
The proliferation of pretrained models, as a result of advancements in pretraining
techniques, has led to the emergence of a vast zoo of publicly available models. Effectively …