What makes reading comprehension questions easier?

S Sugawara, K Inui, S Sekine, A Aizawa - arxiv preprint arxiv:1808.09384, 2018 - arxiv.org
A challenge in creating a dataset for machine reading comprehension (MRC) is to collect
questions that require a sophisticated understanding of language to answer beyond using …

Assessing the benchmarking capacity of machine reading comprehension datasets

S Sugawara, P Stenetorp, K Inui, A Aizawa - Proceedings of the AAAI …, 2020 - aaai.org
Existing analysis work in machine reading comprehension (MRC) is largely concerned with
evaluating the capabilities of systems. However, the capabilities of datasets are not …

Machine reading comprehension: The role of contextualized language models and beyond

Z Zhang, H Zhao, R Wang - arxiv preprint arxiv:2005.06249, 2020 - arxiv.org
Machine reading comprehension (MRC) aims to teach machines to read and comprehend
human languages, which is a long-standing goal of natural language processing (NLP) …

CliCR: a dataset of clinical case reports for machine reading comprehension

S Šuster, W Daelemans - arxiv preprint arxiv:1803.09720, 2018 - arxiv.org
We present a new dataset for machine comprehension in the medical domain. Our dataset
uses clinical case reports with around 100,000 gap-filling queries about these cases. We …

QA4MRE 2011-2013: Overview of question answering for machine reading evaluation

A Peñas, E Hovy, P Forner, A Rodrigo… - … , and Visualization: 4th …, 2013 - Springer
This paper describes the methodology for testing the performance of Machine Reading
systems through Question Answering and Reading Comprehension Tests. This was the …

A study about the future evaluation of Question-Answering systems

A Rodrigo, A Penas - Knowledge-Based Systems, 2017 - Elsevier
Abstract Evaluation campaigns of Question Answering (QA) systems have contributed to the
development of such technologies. These campaigns have promoted some changes …

Evaluation metrics for machine reading comprehension: Prerequisite skills and readability

S Sugawara, Y Kido, H Yokono… - Proceedings of the 55th …, 2017 - aclanthology.org
Knowing the quality of reading comprehension (RC) datasets is important for the
development of natural-language understanding systems. In this study, two classes of …

Arabic question answering systems: gap analysis

MM Biltawi, S Tedmori, A Awajan - IEEE Access, 2021 - ieeexplore.ieee.org
Question-answering (QA) systems aim to provide answers for given questions. The answers
can be extracted or generated from either unstructured or structured text. Therefore, QA is …

Benchmarking machine reading comprehension: A psychological perspective

S Sugawara, P Stenetorp, A Aizawa - arxiv preprint arxiv:2004.01912, 2020 - arxiv.org
Machine reading comprehension (MRC) has received considerable attention as a
benchmark for natural language understanding. However, the conventional task design of …

[PDF][PDF] A Data-Driven Approach for Measuring the Severity of the Signs of Depression using Reddit Posts.

P Van Rijen, D Teodoro, N Naderi… - CLEF …, 2019 - access.archive-ouverte.unige.ch
In response to the CLEF eRisk 2019 shared task on measuring the severity of the signs of
depression from threads of user submissions on social media, our team has developed a …