Multimodal learning provides a path to fully utilize all types of information related to the
modeling target to provide the model with a global vision. Zero‐shot learning (ZSL) is a …

Learning effective joint embedding for cross-modal data has always been a focus in the field
of multimodal machine learning. We argue that during multimodal fusion, the generated …

NLP research is impeded by a lack of resources and awareness of the challenges presented
by underrepresented languages and dialects. Focusing on the languages spoken in …

State-of-the-art abstractive summarization models generally rely on extensive labeled data,
which lowers their generalization ability on domains where such data are not available. In …

Sarcasm is a case of implicit emotion and needs additional information like context and
multimodality for better detection. But sometimes, this additional information also fails to help …

Emotion recognition has been an active research area for a long time. Recently, multimodal
emotion recognition from video data has grown in importance with the explosion of video …

Multimodal abstractive summarization (MAS) models that summarize videos (vision
modality) and their corresponding transcripts (text modality) are able to extract the essential …

Existing works on multimodal affective computing tasks, such as emotion recognition,
generally adopt a two-phase pipeline, first extracting feature representations for each single …

Human brain extracts the spatial and temporal semantic information by processing the multi-
modalities, which has contextually meaningful for perceiving and understanding the …

Automatically recognising apparent emotions from face and voice is hard, in part because of
various sources of uncertainty, including in the input data and the labels used in a machine …