Retrieving and reading: A comprehensive survey on open-domain question answering

F Zhu, W Lei, C Wang, J Zheng, S Poria… - arxiv preprint arxiv …, 2021 - arxiv.org
Open-domain Question Answering (OpenQA) is an important task in Natural Language
Processing (NLP), which aims to answer a question in the form of natural language based …

[HTML][HTML] Neural, symbolic and neural-symbolic reasoning on knowledge graphs

J Zhang, B Chen, L Zhang, X Ke, H Ding - AI Open, 2021 - Elsevier
Abstract Knowledge graph reasoning is the fundamental component to support machine
learning applications such as information extraction, information retrieval, and …

[HTML][HTML] Pre-trained models: Past, present and future

X Han, Z Zhang, N Ding, Y Gu, X Liu, Y Huo, J Qiu… - AI Open, 2021 - Elsevier
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved
great success and become a milestone in the field of artificial intelligence (AI). Owing to …

Neuro-symbolic artificial intelligence: Current trends

MK Sarker, L Zhou, A Eberhart… - Ai …, 2022 - journals.sagepub.com
Neuro-Symbolic Artificial Intelligence–the combination of symbolic methods with methods
that are based on artificial neural networks–has a long-standing history. In this article, we …

Inductive relation prediction by subgraph reasoning

K Teru, E Denis, W Hamilton - International conference on …, 2020 - proceedings.mlr.press
The dominant paradigm for relation prediction in knowledge graphs involves learning and
operating on latent representations (ie, embeddings) of entities and relations. However …

Longrag: Enhancing retrieval-augmented generation with long-context llms

Z Jiang, X Ma, W Chen - arxiv preprint arxiv:2406.15319, 2024 - arxiv.org
In traditional RAG framework, the basic retrieval units are normally short. The common
retrievers like DPR normally work with 100-word Wikipedia paragraphs. Such a design …

Open question answering over tables and text

W Chen, MW Chang, E Schlinger, W Wang… - arxiv preprint arxiv …, 2020 - arxiv.org
In open question answering (QA), the answer to a question is produced by retrieving and
then analyzing documents that might contain answers to the question. Most open QA …

Complex knowledge base question answering: A survey

Y Lan, G He, J Jiang, J Jiang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Knowledge base question answering (KBQA) aims to answer a question over a knowledge
base (KB). Early studies mainly focused on answering simple questions over KBs and …

Modifying memories in transformer models

C Zhu, AS Rawat, M Zaheer, S Bhojanapalli… - arxiv preprint arxiv …, 2020 - arxiv.org
Large Transformer models have achieved impressive performance in many natural
language tasks. In particular, Transformer based language models have been shown to …

Language models are open knowledge graphs

C Wang, X Liu, D Song - arxiv preprint arxiv:2010.11967, 2020 - arxiv.org
This paper shows how to construct knowledge graphs (KGs) from pre-trained language
models (eg, BERT, GPT-2/3), without human supervision. Popular KGs (eg, Wikidata, NELL) …