Survey on factuality in large language models: Knowledge, retrieval and domain-specificity
This survey addresses the crucial issue of factuality in Large Language Models (LLMs). As
LLMs find applications across diverse domains, the reliability and accuracy of their outputs …
LLMs find applications across diverse domains, the reliability and accuracy of their outputs …
Combating misinformation in the age of llms: Opportunities and challenges
Misinformation such as fake news and rumors is a serious threat for information ecosystems
and public trust. The emergence of large language models (LLMs) has great potential to …
and public trust. The emergence of large language models (LLMs) has great potential to …
Siren's song in the AI ocean: a survey on hallucination in large language models
While large language models (LLMs) have demonstrated remarkable capabilities across a
range of downstream tasks, a significant concern revolves around their propensity to exhibit …
range of downstream tasks, a significant concern revolves around their propensity to exhibit …
A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions
The emergence of large language models (LLMs) has marked a significant breakthrough in
natural language processing (NLP), fueling a paradigm shift in information acquisition …
natural language processing (NLP), fueling a paradigm shift in information acquisition …
Chain-of-verification reduces hallucination in large language models
Generation of plausible yet incorrect factual information, termed hallucination, is an
unsolved issue in large language models. We study the ability of language models to …
unsolved issue in large language models. We study the ability of language models to …
Physics of language models: Part 3.1, knowledge storage and extraction
Large language models (LLMs) can store a vast amount of world knowledge, often
extractable via question-answering (eg," What is Abraham Lincoln's birthday?"). However …
extractable via question-answering (eg," What is Abraham Lincoln's birthday?"). However …
A comprehensive survey of hallucination mitigation techniques in large language models
As Large Language Models (LLMs) continue to advance in their ability to write human-like
text, a key challenge remains around their tendency to hallucinate generating content that …
text, a key challenge remains around their tendency to hallucinate generating content that …
Attention satisfies: A constraint-satisfaction lens on factual errors of language models
We investigate the internal behavior of Transformer-based Large Language Models (LLMs)
when they generate factually incorrect text. We propose modeling factual queries as …
when they generate factually incorrect text. We propose modeling factual queries as …
Physics of language models: Part 3.2, knowledge manipulation
Language models can store vast amounts of factual knowledge, but their ability to use this
knowledge for logical reasoning remains questionable. This paper explores a language …
knowledge for logical reasoning remains questionable. This paper explores a language …
Fine tuning vs. retrieval augmented generation for less popular knowledge
Language Models (LMs) memorize a vast amount of factual knowledge, exhibiting strong
performance across diverse tasks and domains. However, it has been observed that the …
performance across diverse tasks and domains. However, it has been observed that the …