In-context vectors: Making in context learning more effective and controllable through latent space steering

S Liu, H Ye, L **ng, J Zou - arxiv preprint arxiv:2311.06668, 2023 - arxiv.org
Large language models (LLMs) demonstrate emergent in-context learning capabilities,
where they adapt to new tasks based on example demonstrations. However, in-context …

Spurious correlations in machine learning: A survey

W Ye, G Zheng, X Cao, Y Ma, A Zhang - arxiv preprint arxiv:2402.12715, 2024 - arxiv.org
Machine learning systems are known to be sensitive to spurious correlations between non-
essential features of the inputs (eg, background, texture, and secondary objects) and the …

Group robust classification without any group information

C Tsirigotis, J Monteiro, P Rodriguez… - Advances in …, 2024 - proceedings.neurips.cc
Empirical risk minimization (ERM) is sensitive to spurious correlations present in training
data, which poses a significant risk when deploying systems trained under this paradigm in …

On harmonizing implicit subpopulations

F Hong, J Yao, Y Lyu, Z Zhou, I Tsang… - The Twelfth …, 2023 - openreview.net
Machine learning algorithms learned from data with skewed distributions usually suffer from
poor generalization, especially when minority classes matter as much as, or even more than …

Automated radiotherapy treatment planning guided by GPT-4Vision

S Liu, O Pastor-Serrano, Y Chen… - arxiv preprint arxiv …, 2024 - arxiv.org
Radiotherapy treatment planning is a time-consuming and potentially subjective process
that requires the iterative adjustment of model parameters to balance multiple conflicting …

The Pitfalls of Memorization: When Memorization Hurts Generalization

R Bayat, M Pezeshki, E Dohmatob… - arxiv preprint arxiv …, 2024 - arxiv.org
Neural networks often learn simple explanations that fit the majority of the data while
memorizing exceptions that deviate from these explanations. This behavior leads to poor …

Quantifying spuriousness of biased datasets using partial information decomposition

B Halder, F Hamman, P Dissanayake, Q Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Spurious patterns refer to a mathematical association between two or more variables in a
dataset that are not causally related. However, this notion of spuriousness, which is usually …

Mitigating Spurious Correlations via Disagreement Probability

H Han, S Kim, H Joo, S Hong, J Lee - arxiv preprint arxiv:2411.01757, 2024 - arxiv.org
Models trained with empirical risk minimization (ERM) are prone to be biased towards
spurious correlations between target labels and bias attributes, which leads to poor …

Rebalanced supervised contrastive learning with prototypes for long-tailed visual recognition

X Chang, J Zhai, S Qiu, Z Sun - Computer Vision and Image Understanding, 2025 - Elsevier
In the real world, data often follows a long-tailed distribution, resulting in head classes
receiving more attention while tail classes are frequently overlooked. Although supervised …

Compositional Risk Minimization

D Mahajan, M Pezeshki, I Mitliagkas, K Ahuja… - arxiv preprint arxiv …, 2024 - arxiv.org
In this work, we tackle a challenging and extreme form of subpopulation shift, which is
termed compositional shift. Under compositional shifts, some combinations of attributes are …