Attention in natural language processing
Attention is an increasingly popular mechanism used in a wide range of neural
architectures. The mechanism itself has been realized in a variety of formats. However …
architectures. The mechanism itself has been realized in a variety of formats. However …
Neural approaches to conversational AI
This tutorial surveys neural approaches to conversational AI that were developed in the last
few years. We group conversational systems into three categories:(1) question answering …
few years. We group conversational systems into three categories:(1) question answering …
Attention, please! A survey of neural attention models in deep learning
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …
limited ability to process competing sources, attention mechanisms select, modulate, and …
Cosmos QA: Machine reading comprehension with contextual commonsense reasoning
Understanding narratives requires reading between the lines, which in turn, requires
interpreting the likely causes and effects of events, even when they are not mentioned …
interpreting the likely causes and effects of events, even when they are not mentioned …
Race: Large-scale reading comprehension dataset from examinations
We present RACE, a new dataset for benchmark evaluation of methods in the reading
comprehension task. Collected from the English exams for middle and high school Chinese …
comprehension task. Collected from the English exams for middle and high school Chinese …
Gated self-matching networks for reading comprehension and question answering
In this paper, we present the gated self-matching networks for reading comprehension style
question answering, which aims to answer questions from a given passage. We first match …
question answering, which aims to answer questions from a given passage. We first match …
Pullnet: Open domain question answering with iterative retrieval on knowledge bases and text
We consider open-domain queston answering (QA) where answers are drawn from either a
corpus, a knowledge base (KB), or a combination of both of these. We focus on a setting in …
corpus, a knowledge base (KB), or a combination of both of these. We focus on a setting in …
Retrospective reader for machine reading comprehension
Abstract Machine reading comprehension (MRC) is an AI challenge that requires machines
to determine the correct answers to questions based on a given passage. MRC systems …
to determine the correct answers to questions based on a given passage. MRC systems …
An introductory survey on attention mechanisms in NLP problems
D Hu - Intelligent Systems and Applications: Proceedings of …, 2020 - Springer
First derived from human intuition, later adapted to machine translation for automatic token
alignment, attention mechanism, a simple method that can be used for encoding sequence …
alignment, attention mechanism, a simple method that can be used for encoding sequence …
Logiqa: A challenge dataset for machine reading comprehension with logical reasoning
Machine reading is a fundamental task for testing the capability of natural language
understanding, which is closely related to human cognition in many aspects. With the rising …
understanding, which is closely related to human cognition in many aspects. With the rising …