As Large Language Models (LLMs) become popular, there emerged an important trend of
using multimodality to augment the LLMs' generation ability, which enables LLMs to better …

Sign language translation (SLT) aims to convert a continuous sign language video clip into a
spoken language. Considering different geographic regions generally have their own native …

In modern recommender systems, there are usually comments or reviews from users that
justify their ratings for different items. Trained on such textual corpus, explainable …

People often imagine relevant scenes to aid in the writing process. In this work, we aim to
utilize visual information for composition in the same manner as humans. We propose a …

Open-domain multi-modal dialogue system heavily relies on visual information to generate
contextually relevant responses. The existing open-domain multi-modal dialog generation …

Image-grounded dialogue systems benefit greatly from integrating visual information,
resulting in high-quality response generation. However, current models struggle to …

Integrating multimodal knowledge into large language models (LLMs) represents a
significant advancement in dialogue generation capabilities. However, the effective …

Being able to reply with a related, fluent, and informative response is an indispensable
requirement for building high-quality conversational agents. In order to generate better …

Commonsense knowledge has been widely considered for building intelligent open-domain
dialogue agents, aiming to generate meaningful and diverse responses. Previous works in …

Incorporating visual knowledge into text-only dialogue systems has become a potential
direction to imitate the way humans think, imagine, and communicate. However, existing …