Reasoning about actions over visual and linguistic modalities: A survey

SK Sampat, M Patel, S Das, Y Yang, C Baral - ar** track of how states of entities change as a text or dialog unfolds is a key
prerequisite to discourse understanding. Yet, there have been few systematic investigations …

Reasoning about procedures with natural language processing: A tutorial

L Zhang - arxiv preprint arxiv:2205.07455, 2022 - arxiv.org
This tutorial provides a comprehensive and in-depth view of the research on procedures,
primarily in Natural Language Processing. A procedure is a sequence of steps intended to …

Causal reasoning of entities and events in procedural texts

L Zhang, H Xu, Y Yang, S Zhou, W You, M Arora… - arxiv preprint arxiv …, 2023 - arxiv.org
Entities and events are crucial to natural language reasoning and common in procedural
texts. Existing work has focused either exclusively on entity state tracking (eg, whether a pan …

Gluecons: A generic benchmark for learning under constraints

HR Faghihi, A Nafar, C Zheng, R Mirzaee… - Proceedings of the …, 2023 - ojs.aaai.org
Recent research has shown that integrating domain knowledge into deep learning
architectures is effective; It helps reduce the amount of required data, improves the accuracy …

Life is a circus and we are the clowns: Automatically finding analogies between situations and processes

O Sultan, D Shahaf - arxiv preprint arxiv:2210.12197, 2022 - arxiv.org
Analogy-making gives rise to reasoning, abstraction, flexible categorization and
counterfactual inference--abilities lacking in even the best AI systems today. Much research …

Show me more details: Discovering hierarchies of procedures from semi-structured web data

S Zhou, L Zhang, Y Yang, Q Lyu, P Yin… - arxiv preprint arxiv …, 2022 - arxiv.org
Procedures are inherently hierarchical. To" make videos", one may need to" purchase a
camera", which in turn may require one to" set a budget". While such hierarchical knowledge …

EXAMS: A multi-subject high school examinations dataset for cross-lingual and multilingual question answering

M Hardalov, T Mihaylov, D Zlatkova, Y Dinkov… - arxiv preprint arxiv …, 2020 - arxiv.org
We propose EXAMS--a new benchmark dataset for cross-lingual and multilingual question
answering for high school examinations. We collected more than 24,000 high-quality high …

A systematic survey of text worlds as embodied natural language environments

PA Jansen - arxiv preprint arxiv:2107.04132, 2021 - arxiv.org
Text Worlds are virtual environments for embodied agents that, unlike 2D or 3D
environments, are rendered exclusively using textual descriptions. These environments offer …

Choice-75: A dataset on decision branching in script learning

ZJ Hou, L Zhang, C Callison-Burch - arxiv preprint arxiv:2309.11737, 2023 - arxiv.org
Script learning studies how daily events unfold. Previous works tend to consider a script as a
linear sequence of events while ignoring the potential branches that arise due to people's …