Learning to tokenize for generative retrieval

W Sun, L Yan, Z Chen, S Wang, H Zhu… - Advances in …, 2023 - proceedings.neurips.cc
As a new paradigm in information retrieval, generative retrieval directly generates a ranked
list of document identifiers (docids) for a given query using generative language models …

From matching to generation: A survey on generative information retrieval

X Li, J **, Y Zhou, Y Zhang, P Zhang, Y Zhu… - arxiv preprint arxiv …, 2024 - arxiv.org
Information Retrieval (IR) systems are crucial tools for users to access information, widely
applied in scenarios like search engines, question answering, and recommendation …

Recent advances in generative information retrieval

Y Tang, R Zhang, J Guo, M de Rijke - … in Information Retrieval in the Asia …, 2023 - dl.acm.org
Generative retrieval (GR) has become a highly active area of information retrieval (IR) that
has witnessed significant growth recently. Compared to the traditional “index-retrieve-then …

Planning ahead in generative retrieval: Guiding autoregressive generation through simultaneous decoding

H Zeng, C Luo, H Zamani - Proceedings of the 47th International ACM …, 2024 - dl.acm.org
This paper introduces PAG-a novel optimization and decoding approach that guides
autoregressive generation of document identifiers in generative retrieval models through …

Scalable and effective generative information retrieval

H Zeng, C Luo, B **, SM Sarwar, T Wei… - Proceedings of the ACM …, 2024 - dl.acm.org
Recent research has shown that transformer networks can be used as differentiable search
indexes by representing each document as a sequence of document ID tokens. These …

Generative retrieval as multi-vector dense retrieval

S Wu, W Wei, M Zhang, Z Chen, J Ma, Z Ren… - Proceedings of the 47th …, 2024 - dl.acm.org
For a given query generative retrieval generates identifiers of relevant documents in an end-
to-end manner using a sequence-to-sequence architecture. The relation between …

Listwise generative retrieval models via a sequential learning process

Y Tang, R Zhang, J Guo, M de Rijke, W Chen… - ACM Transactions on …, 2024 - dl.acm.org
Recently, a novel generative retrieval (GR) paradigm has been proposed, where a single
sequence-to-sequence model is learned to directly generate a list of relevant document …

GLEN: Generative retrieval via lexical index learning

S Lee, M Choi, J Lee - arxiv preprint arxiv:2311.03057, 2023 - arxiv.org
Generative retrieval shed light on a new paradigm of document retrieval, aiming to directly
generate the identifier of a relevant document for a query. While it takes advantage of …

Generative Subgraph Retrieval for Knowledge Graph-Grounded Dialog Generation

J Park, M Joo, JK Kim, HJ Kim - arxiv preprint arxiv:2410.09350, 2024 - arxiv.org
Knowledge graph-grounded dialog generation requires retrieving a dialog-relevant
subgraph from the given knowledge base graph and integrating it with the dialog history …

KTRL+ F: Knowledge-Augmented In-Document Search

H Oh, H Shin, M Ko, H Lee, M Seo - arxiv preprint arxiv:2311.08329, 2023 - arxiv.org
We introduce a new problem KTRL+ F, a knowledge-augmented in-document search task
that necessitates real-time identification of all semantic targets within a document with the …