Eliminating position bias of language models: A mechanistic approach

Z Wang, H Zhang, X Li, KH Huang, C Han, S Ji… - arxiv preprint arxiv …, 2024 - arxiv.org
Position bias has proven to be a prevalent issue of modern language models (LMs), where
the models prioritize content based on its position within the given context. This bias often …