A Textual Dataset for Situated Proactive Response Selection

N Otani, J Araki, HS Kim, E Hovy - … of the 61st Annual Meeting of …, 2023 - aclanthology.org
Recent data-driven conversational models are able to return fluent, consistent, and
informative responses to many kinds of requests and utterances in task-oriented scenarios …

PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities

SL Sravanthi, M Doshi, TP Kalyan, R Murthy… - arxiv preprint arxiv …, 2024 - arxiv.org
LLMs have demonstrated remarkable capability for understanding semantics, but they often
struggle with understanding pragmatics. To demonstrate this fact, we release a Pragmatics …