We explore multi-modal contextual knowledge learned through multi-modal masked
language modeling to provide explicit localization guidance for novel classes in open …

Unintentional action localization (UAL) is a challenging task that requires reasoning about
action intention clues to detect the temporal locations of unintentional action occurrences in …

Open-vocabulary 3D Object Detection (OV-3DDet) addresses the detection of objects from
an arbitrary list of novel categories in 3D scenes, which remains a very challenging problem …

Embodied reference understanding is crucial for intelligent agents to predict referents based
on human intention through gesture signals and language descriptions. This paper …

Recent research on universal object detection aims to introduce language in a SoTA closed-
set detector and then generalize the open-set concepts by constructing large-scale (text …

Open-vocabulary object detection (OVD) models are considered to be Large Multi-modal
Models (LMM), due to their extensive training data and a large number of parameters …