Framework for deep learning-based language models using multi-task learning in natural language understanding: A systematic literature review and future directions

RM Samant, MR Bachute, S Gite, K Kotecha - IEEE Access, 2022 - ieeexplore.ieee.org
Learning human languages is a difficult task for a computer. However, Deep Learning (DL)
techniques have enhanced performance significantly for almost all-natural language …

Recent trends in deep learning based open-domain textual question answering systems

Z Huang, S Xu, M Hu, X Wang, J Qiu, Y Fu… - IEEE …, 2020 - ieeexplore.ieee.org
Open-domain textual question answering (QA), which aims to answer questions from large
data sources like Wikipedia or the web, has gained wide attention in recent years. Recent …

Kagnet: Knowledge-aware graph networks for commonsense reasoning

BY Lin, X Chen, J Chen, X Ren - arxiv preprint arxiv:1909.02151, 2019 - arxiv.org
Commonsense reasoning aims to empower machines with the human ability to make
presumptions about ordinary situations in our daily life. In this paper, we propose a textual …

Retrospective reader for machine reading comprehension

Z Zhang, J Yang, H Zhao - Proceedings of the AAAI conference on …, 2021 - ojs.aaai.org
Abstract Machine reading comprehension (MRC) is an AI challenge that requires machines
to determine the correct answers to questions based on a given passage. MRC systems …

Simple and effective multi-paragraph reading comprehension

C Clark, M Gardner - arxiv preprint arxiv:1710.10723, 2017 - arxiv.org
We consider the problem of adapting neural paragraph-level question answering models to
the case where entire documents are given as input. Our proposed solution trains models to …

Scalable multi-hop relational reasoning for knowledge-aware question answering

Y Feng, X Chen, BY Lin, P Wang, J Yan… - arxiv preprint arxiv …, 2020 - arxiv.org
Existing work on augmenting question answering (QA) models with external knowledge (eg,
knowledge graphs) either struggle to model multi-hop relations efficiently, or lack …

Commonsense for generative multi-hop question answering tasks

L Bauer, Y Wang, M Bansal - arxiv preprint arxiv:1809.06309, 2018 - arxiv.org
Reading comprehension QA tasks have seen a recent surge in popularity, yet most works
have focused on fact-finding extractive QA. We instead focus on a more challenging multi …

Dynamic neuro-symbolic knowledge graph construction for zero-shot commonsense question answering

A Bosselut, R Le Bras, Y Choi - Proceedings of the AAAI conference on …, 2021 - ojs.aaai.org
Understanding narratives requires reasoning about implicit world knowledge related to the
causes, effects, and states of situations described in text. At the core of this challenge is how …

Knowledgeable reader: Enhancing cloze-style reading comprehension with external commonsense knowledge

T Mihaylov, A Frank - arxiv preprint arxiv:1805.07858, 2018 - arxiv.org
We introduce a neural reading comprehension model that integrates external commonsense
knowledge, encoded as a key-value memory, in a cloze-style setting. Instead of relying only …

Unsupervised question answering by cloze translation

P Lewis, L Denoyer, S Riedel - arxiv preprint arxiv:1906.04980, 2019 - arxiv.org
Obtaining training data for Question Answering (QA) is time-consuming and resource-
intensive, and existing QA datasets are only available for limited domains and languages. In …