Multi-party goal tracking with llms: Comparing pre-training, fine-tuning, and prompt engineering

A Addlesee, W Sieińska, N Gunson, DH Garcia… - arxiv preprint arxiv …, 2023 - arxiv.org
This paper evaluates the extent to which current Large Language Models (LLMs) can
capture task-oriented multi-party conversations (MPCs). We have recorded and transcribed …

Multi-party multimodal conversations between patients, their companions, and a social robot in a hospital memory clinic

A Addlesee, N Cherakara, N Nelson… - 18th Conference of …, 2024 - researchportal.hw.ac.uk
We have deployed an LLM-based spoken dialogue system in a real hospital. The ARI social
robot embodies our system, which patients and their companions can have multi-party …

The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systems

A Liesenfeld, A Lopez, M Dingemanse - arxiv preprint arxiv:2307.15493, 2023 - arxiv.org
Speech recognition systems are a key intermediary in voice-driven human-computer
interaction. Although speech recognition works well for pristine monologic audio, real-life …

You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification

A Addlesee, A Eshghi - Frontiers in Dementia, 2024 - frontiersin.org
In spontaneous conversation, speakers seldom have a full plan of what they are going to say
in advance: they need to conceptualise and plan incrementally as they articulate each word …

Building for speech: designing the next-generation of social robots for audio interaction

A Addlesee, I Papaioannou - Frontiers in Robotics and AI, 2025 - frontiersin.org
There have been significant advances in robotics, conversational AI, and spoken dialogue
systems (SDSs) over the past few years, but we still do not find social robots in public spaces …

[HTML][HTML] Understanding disrupted sentences using underspecified abstract meaning representation

A Addlesee, M Damonte - 2023 - amazon.science
Voice assistant accessibility is generally overlooked as today's spoken dialogue systems are
trained on huge corpora to help them understand the 'average'user. This raises frustrating …

Detecting agreement in multi-party dialogue: evaluating speaker diarisation versus a procedural baseline to enhance user engagement

A Addlesee, D Denley, A Edmondson… - arxiv preprint arxiv …, 2023 - arxiv.org
Conversational agents participating in multi-party interactions face significant challenges in
dialogue state tracking, since the identity of the speaker adds significant contextual …

Seeking Truth, Comfort, and Connection: How Conversational User Interfaces can help Couples with Dementia Manage Reality Disjunction

Y Ruitenburg, M Lee, W IJsselsteijn… - Proceedings of the 6th …, 2024 - dl.acm.org
Reality disjunction, when people present contradicting worldviews as true, frequently occurs
in conversations between people with dementia and their partners due to memory gaps …

Learning to generate and corr-uh I mean repair language in real-time

A Eshghi, A Ashrafzadeh - arxiv preprint arxiv:2308.11683, 2023 - arxiv.org
In conversation, speakers produce language incrementally, word by word, while
continuously monitoring the appropriateness of their own contribution in the dynamically …

It Couldn't Help But Overhear: On the Limits of Modelling Meta-Communicative Grounding Acts with Supervised Learning

B Madureira, D Schlangen - arxiv preprint arxiv:2405.01139, 2024 - arxiv.org
Active participation in a conversation is key to building common ground, since
understanding is jointly tailored by producers and recipients. Overhearers are deprived of …