Abstract Speech-to-Text (ST) translation pertains to the task of converting speech signals in
one language to text in another language. It finds its application in various domains, such as …

Contrastive learning has emerged as a powerful technique in audio-visual representation
learning, leveraging the natural co-occurrence of audio and visual modalities in extensive …

Following the remarkable success of Large Language Models (LLMs) in NLP tasks, there is
increasing interest in extending their capabilities to speech--the most common form in …

The prosody of a spoken utterance, including features like stress, intonation and rhythm, can
significantly affect the underlying semantics, and as a consequence can also affect its textual …

Multimodal foundation models aim to create a unified representation space that abstracts
away from surface features like language syntax or modality differences. To investigate this …

Large language models (LLMs) excel in natural language processing but adapting these
LLMs to speech processing tasks efficiently is not straightforward. Direct task-specific fine …