Flatness-aware minimization for domain generalization

X Zhang, R Xu, H Yu, Y Dong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Domain generalization (DG) seeks to learn robust models that generalize well
under unknown distribution shifts. As a critical aspect of DG, optimizer selection has not …

Disentangled Prompt Representation for Domain Generalization

D Cheng, Z Xu, X Jiang, N Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Domain Generalization (DG) aims to develop a versatile model capable of
performing well on unseen target domains. Recent advancements in pre-trained Visual …

Rethinking the evaluation protocol of domain generalization

H Yu, X Zhang, R Xu, J Liu, Y He… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Domain generalization aims to solve the challenge of Out-of-Distribution (OOD)
generalization by leveraging common knowledge learned from multiple training domains to …

Your mixture-of-experts llm is secretly an embedding model for free

Z Li, T Zhou - arxiv preprint arxiv:2410.10814, 2024 - arxiv.org
While large language models (LLMs) excel on generation tasks, their decoder-only
architecture often limits their potential as embedding models if no further representation …

Dawin: Training-free dynamic weight interpolation for robust adaptation

C Oh, Y Li, K Song, S Yun, D Han - arxiv preprint arxiv:2410.03782, 2024 - arxiv.org
Adapting a pre-trained foundation model on downstream tasks should ensure robustness
against distribution shifts without the need to retrain the whole model. Although existing …