Multimodal interfaces: Challenges and perspectives

N Sebe - Journal of Ambient Intelligence and smart …, 2009 - journals.sagepub.com
The development of interfaces has been a technology-driven process. However, the newly
developed multimodal interfaces are using recognition-based technologies that must …

Some background on dialogue management and conversational speech for dialogue systems

Y Wilks, R Catizone, S Worgan, M Turunen - Computer Speech & …, 2011 - Elsevier
This special issue of the Journal is concerned with speech and language processing issues
in the overall environment of end-to-end dialogue systems, and in particular with the sorts of …

“I didn't catch that, but I'll try my best”: Anticipatory error handling in a voice controlled game

N Zargham, J Pfau, T Schnackenberg… - Proceedings of the 2022 …, 2022 - dl.acm.org
Advances in speech recognition, language processing and natural interaction have led to an
increased industrial and academic interest. While the robustness and usability of such …

GlassMail: Towards Personalised Wearable Assistant for On-the-Go Email Creation on Smart Glasses

C Zhou, Z Yan, A Ram, Y Gu, Y **ang, C Liu… - Proceedings of the …, 2024 - dl.acm.org
Optical See-through Head-Mounted Displays (OHMDs) offer new opportunities for
completing complex information processing tasks on the go. We introduce GlassMail, a …

Multimodal and mobile conversational health and fitness companions

M Turunen, J Hakulinen, O Ståhl, B Gambäck… - Computer Speech & …, 2011 - Elsevier
Multimodal conversational spoken dialogues using physical and virtual agents provide a
potential interface to motivate and support users in the domain of health and fitness. In this …

Modelling multi-issue bargaining dialogues: Data collection, annotation design and corpus

V Petukhova, C Stevens, H De Weerd… - Proceedings of the …, 2016 - aclanthology.org
The paper describes experimental dialogue data collection activities, as well semantically
annotated corpus creation undertaken within EU-funded METALOGUE project (www …

Multidimensional dialogue management

S Keizer, H Bunt, V Petukhova - Interactive Multi-modal Question …, 2011 - Springer
In natural language dialogue, contributions from the participants are generally
multifunctional, that is, in a single contribution a speaker addresses multiple aspects of …

[PDF][PDF] Evaluation of a spoken dialogue system with usability tests and long-term pilot studies: similarities and differences.

M Turunen, J Hakulinen, A Kainulainen - INTERSPEECH, 2006 - academia.edu
We present findings from the long-term study of a speech-based bus timetable system. After
the deployment of the prototype system we have collected data from real usage for 30 …

[PDF][PDF] Multi-policy dialogue management

P Lison - Proceedings of the SIGDIAL 2011 Conference, 2011 - aclanthology.org
We present a new approach to dialogue management based on the use of multiple,
interconnected policies. Instead of capturing the complexity of the interaction in a single …

JVoiceXML as a modality component in the W3C multimodal architecture: Experiences implementing the W3C standard

D Schnelle-Walka, S Radomski… - Journal on Multimodal User …, 2013 - Springer
Research regarding multimodal interaction led to a multitude of proposals for suitable
software architectures. With all architectures describing multimodal systems differently …