Knowledge graphs meet multi-modal learning: A comprehensive survey

Z Chen, Y Zhang, Y Fang, Y Geng, L Guo… - arxiv preprint arxiv …, 2024 - arxiv.org
Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the
semantic web community's exploration into multi-modal dimensions unlocking new avenues …

Learn from relational correlations and periodic events for temporal knowledge graph reasoning

K Liang, L Meng, M Liu, Y Liu, W Tu, S Wang… - Proceedings of the 46th …, 2023 - dl.acm.org
Reasoning on temporal knowledge graphs (TKGR), aiming to infer missing events along the
timeline, has been widely studied to alleviate incompleteness issues in TKG, which is …

Tmac: Temporal multi-modal graph learning for acoustic event classification

M Liu, K Liang, D Hu, H Yu, Y Liu, L Meng… - Proceedings of the 31st …, 2023 - dl.acm.org
Audiovisual data is everywhere in this digital age, which raises higher requirements for the
deep learning models developed on them. To well handle the information of the multi-modal …

Understanding translationese in cross-lingual summarization

J Wang, F Meng, Y Liang, T Zhang, J Xu, Z Li… - arxiv preprint arxiv …, 2022 - arxiv.org
Given a document in a source language, cross-lingual summarization (CLS) aims at
generating a concise summary in a different target language. Unlike monolingual …

A survey: knowledge graph entity alignment research based on graph embedding

B Zhu, R Wang, J Wang, F Shao, K Wang - Artificial Intelligence Review, 2024 - Springer
Entity alignment (EA) aims to automatically match entities in different knowledge graphs,
which is beneficial to the development of knowledge-driven applications. Representation …

Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding

X Fang, D Liu, W Fang, P Zhou, Y Cheng… - Findings of the …, 2023 - aclanthology.org
This paper addresses the task of temporal sentence grounding (TSG). Although many
respectable works have made decent achievements in this important topic, they severely …

Self-supervised opinion summarization with multi-modal knowledge graph

L **, J Chen - Journal of Intelligent Information Systems, 2024 - Springer
Multi-modal opinion summarization aims at automatically generating summaries of products
or businesses from multi-modal reviews containing text, image and table to present clear …

Multi-modal knowledge graph transformer framework for multi-modal entity alignment

Q Li, C Ji, S Guo, Z Liang, L Wang, J Li - arxiv preprint arxiv:2310.06365, 2023 - arxiv.org
Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity
pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges …

Universal multi-modal entity alignment via iteratively fusing modality similarity paths

B Zhu, X Liu, X Mao, Z Chen, L Guo, T Gui… - arxiv preprint arxiv …, 2023 - arxiv.org
The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple
Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of …

Similarity propagation based semi-supervised entity alignment

Z Yan, R Peng, H Wu - Engineering Applications of Artificial Intelligence, 2024 - Elsevier
Entity alignment aims to identify entities referring to the same real world object among
multiple knowledge graphs. Current embedding based approaches suffer from the lack of …