Retrieval-augmented generation for natural language processing: A survey

S Wu, Y **ong, Y Cui, H Wu, C Chen, Y Yuan… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) have demonstrated great success in various fields,
benefiting from their huge amount of parameters that store knowledge. However, LLMs still …

Text-to-image diffusion models in generative ai: A survey

C Zhang, C Zhang, M Zhang, IS Kweon - arxiv preprint arxiv:2303.07909, 2023 - arxiv.org
This survey reviews text-to-image diffusion models in the context that diffusion models have
emerged to be popular for a wide range of generative tasks. As a self-contained work, this …

Learning to retrieve prompts for in-context learning

O Rubin, J Herzig, J Berant - arxiv preprint arxiv:2112.08633, 2021 - arxiv.org
In-context learning is a recent paradigm in natural language understanding, where a large
pre-trained language model (LM) observes a test instance and a few training examples as …

What Makes Good In-Context Examples for GPT-?

J Liu, D Shen, Y Zhang, B Dolan, L Carin… - arxiv preprint arxiv …, 2021 - arxiv.org
GPT-$3 $ has attracted lots of attention due to its superior performance across a wide range
of NLP tasks, especially with its powerful and versatile in-context few-shot learning ability …

Retrieval augmentation reduces hallucination in conversation

K Shuster, S Poff, M Chen, D Kiela, J Weston - arxiv preprint arxiv …, 2021 - arxiv.org
Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue
models often suffer from factual incorrectness and hallucination of knowledge (Roller et al …

In-context examples selection for machine translation

S Agrawal, C Zhou, M Lewis, L Zettlemoyer… - arxiv preprint arxiv …, 2022 - arxiv.org
Large-scale generative models show an impressive ability to perform a wide range of
Natural Language Processing (NLP) tasks using in-context learning, where a few examples …

Beyond english-centric multilingual machine translation

A Fan, S Bhosale, H Schwenk, Z Ma, A El-Kishky… - Journal of Machine …, 2021 - jmlr.org
Existing work in translation demonstrated the potential of massively multilingual machine
translation by training a single model able to translate between any pair of languages …

Text classification via large language models

X Sun, X Li, J Li, F Wu, S Guo, T Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Despite the remarkable success of large-scale Language Models (LLMs) such as GPT-3,
their performances still significantly underperform fine-tuned models in the task of text …

Retrieval-augmented diffusion models

A Blattmann, R Rombach, K Oktay… - Advances in Neural …, 2022 - proceedings.neurips.cc
Novel architectures have recently improved generative image synthesis leading to excellent
visual quality in various tasks. Much of this success is due to the scalability of these …

Findings of the 2022 conference on machine translation (WMT22)

T Kocmi, R Bawden, O Bojar… - Proceedings of the …, 2022 - aclanthology.org
This paper presents the results of the General Machine Translation Task organised as part
of the Conference on Machine Translation (WMT) 2022. In the general MT task, participants …