Foundations & trends in multimodal machine learning: Principles, challenges, and open questions

PP Liang, A Zadeh, LP Morency - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

PP Liang, A Zadeh, LP Morency - ar** the good and removing the bad momentum causal effect
K Tang, J Huang, H Zhang - Advances in neural information …, 2020 - proceedings.neurips.cc
As the class size grows, maintaining a balanced dataset across many classes is challenging
because the data are long-tailed in nature; it is even impossible when the sample-of-interest …

Causal intervention for weakly-supervised semantic segmentation

D Zhang, H Zhang, J Tang… - Advances in Neural …, 2020 - proceedings.neurips.cc
We present a causal inference framework to improve Weakly-Supervised Semantic
Segmentation (WSSS). Specifically, we aim to generate better pixel-level pseudo-masks by …

Towards artificial general intelligence via a multimodal foundation model

N Fei, Z Lu, Y Gao, G Yang, Y Huo, J Wen, H Lu… - Nature …, 2022 - nature.com
The fundamental goal of artificial intelligence (AI) is to mimic the core cognitive activities of
human. Despite tremendous success in the AI research, most of existing methods have only …

Multi-modal knowledge graph construction and application: A survey

X Zhu, Z Li, X Wang, X Jiang, P Sun… - … on Knowledge and …, 2022 - ieeexplore.ieee.org
Recent years have witnessed the resurgence of knowledge engineering which is featured
by the fast growth of knowledge graphs. However, most of existing knowledge graphs are …

Model-agnostic counterfactual reasoning for eliminating popularity bias in recommender system

T Wei, F Feng, J Chen, Z Wu, J Yi, X He - Proceedings of the 27th ACM …, 2021 - dl.acm.org
The general aim of the recommender system is to provide personalized suggestions to
users, which is opposed to suggesting popular items. However, the normal training …

Good is bad: Causality inspired cloth-debiasing for cloth-changing person re-identification

Z Yang, M Lin, X Zhong, Y Wu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Entangled representation of clothing and identity (ID)-intrinsic clues are potentially
concomitant in conventional person Re-IDentification (ReID). Nevertheless, eliminating the …