Viplo: Vision transformer based pose-conditioned self-loop graph for human-object interaction detection

J Park, JW Park, JS Lee - … of the IEEE/CVF conference on …, 2023 - openaccess.thecvf.com
Abstract Human-Object Interaction (HOI) detection, which localizes and infers relationships
between human and objects, plays an important role in scene understanding. Although two …

Rlipv2: Fast scaling of relational language-image pre-training

H Yuan, S Zhang, X Wang, S Albanie… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Relational Language-Image Pre-training (RLIP) aims to align vision representations
with relational texts, thereby advancing the capability of relational reasoning in computer …

Detecting any human-object interaction relationship: Universal hoi detector with spatial prompt learning on foundation models

Y Cao, Q Tang, X Su, S Chen, S You… - Advances in Neural …, 2023 - proceedings.neurips.cc
Human-object interaction (HOI) detection aims to comprehend the intricate relationships
between humans and objects, predicting triplets, and serving as the foundation for …

Neural-logic human-object interaction detection

L Li, J Wei, W Wang, Y Yang - Advances in Neural …, 2023 - proceedings.neurips.cc
The interaction decoder utilized in prevalent Transformer-based HOI detectors typically
accepts pre-composed human-object pairs as inputs. Though achieving remarkable …

Re-mine, learn and reason: Exploring the cross-modal semantic correlations for language-guided hoi detection

Y Cao, Q Tang, F Yang, X Su, S You… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Human-Object Interaction (HOI) detection is a challenging computer vision task that
requires visual models to address the complex interactive relationship between humans and …

Category query learning for human-object interaction classification

C **e, F Zeng, Y Hu, S Liang… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Unlike most previous HOI methods that focus on learning better human-object features, we
propose a novel and complementary approach called category query learning. Such queries …

Open-world human-object interaction detection via multi-modal prompts

J Yang, B Li, A Zeng, L Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
In this paper we develop MP-HOI a powerful Multi-modal Prompt-based HOI detector
designed to leverage both textual descriptions for open-set generalization and visual …

From detection to understanding: A survey on representation learning for human-object interaction

T Luo, S Guan, R Yang, J Smith - Neurocomputing, 2023 - Elsevier
Abstract Human-Object Interaction (HOI) detection is a critical topic in the visual
understanding field. With the development of deep learning models, the research of HOI …

Exploring the potential of large foundation models for open-vocabulary hoi detection

T Lei, S Yin, Y Liu - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Open-vocabulary human-object interaction (HOI) detection which is concerned with the
problem of detecting novel HOIs guided by natural language is crucial for understanding …

Clip4hoi: Towards adapting clip for practical zero-shot hoi detection

Y Mao, J Deng, W Zhou, L Li… - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract Zero-shot Human-Object Interaction (HOI) detection aims to identify both seen and
unseen HOI categories. A strong zero-shot HOI detector is supposed to be not only capable …