Attention in natural language processing

A Galassi, M Lippi, P Torroni - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Attention is an increasingly popular mechanism used in a wide range of neural
architectures. The mechanism itself has been realized in a variety of formats. However …

Neural approaches to conversational AI

J Gao, M Galley, L Li - The 41st international ACM SIGIR conference on …, 2018 - dl.acm.org
This tutorial surveys neural approaches to conversational AI that were developed in the last
few years. We group conversational systems into three categories:(1) question answering …

Attention, please! A survey of neural attention models in deep learning

A de Santana Correia, EL Colombini - Artificial Intelligence Review, 2022 - Springer
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …

Cosmos QA: Machine reading comprehension with contextual commonsense reasoning

L Huang, RL Bras, C Bhagavatula, Y Choi - arxiv preprint arxiv …, 2019 - arxiv.org
Understanding narratives requires reading between the lines, which in turn, requires
interpreting the likely causes and effects of events, even when they are not mentioned …

Race: Large-scale reading comprehension dataset from examinations

G Lai, Q **e, H Liu, Y Yang, E Hovy - arxiv preprint arxiv:1704.04683, 2017 - arxiv.org
We present RACE, a new dataset for benchmark evaluation of methods in the reading
comprehension task. Collected from the English exams for middle and high school Chinese …

Gated self-matching networks for reading comprehension and question answering

W Wang, N Yang, F Wei, B Chang… - Proceedings of the 55th …, 2017 - aclanthology.org
In this paper, we present the gated self-matching networks for reading comprehension style
question answering, which aims to answer questions from a given passage. We first match …

Pullnet: Open domain question answering with iterative retrieval on knowledge bases and text

H Sun, T Bedrax-Weiss, WW Cohen - arxiv preprint arxiv:1904.09537, 2019 - arxiv.org
We consider open-domain queston answering (QA) where answers are drawn from either a
corpus, a knowledge base (KB), or a combination of both of these. We focus on a setting in …

Retrospective reader for machine reading comprehension

Z Zhang, J Yang, H Zhao - Proceedings of the AAAI conference on …, 2021 - ojs.aaai.org
Abstract Machine reading comprehension (MRC) is an AI challenge that requires machines
to determine the correct answers to questions based on a given passage. MRC systems …

An introductory survey on attention mechanisms in NLP problems

D Hu - Intelligent Systems and Applications: Proceedings of …, 2020 - Springer
First derived from human intuition, later adapted to machine translation for automatic token
alignment, attention mechanism, a simple method that can be used for encoding sequence …

Logiqa: A challenge dataset for machine reading comprehension with logical reasoning

J Liu, L Cui, H Liu, D Huang, Y Wang… - arxiv preprint arxiv …, 2020 - arxiv.org
Machine reading is a fundamental task for testing the capability of natural language
understanding, which is closely related to human cognition in many aspects. With the rising …