Omnivec: Learning robust representations with cross modal sharing
S Srivastava, G Sharma - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
Majority of research in learning based methods has been towards designing and training
networks for specific tasks. However, many of the learning based tasks, across modalities …
networks for specific tasks. However, many of the learning based tasks, across modalities …
Deep Multimodal Data Fusion
Multimodal Artificial Intelligence (Multimodal AI), in general, involves various types of data
(eg, images, texts, or data collected from different sensors), feature engineering (eg …
(eg, images, texts, or data collected from different sensors), feature engineering (eg …
Omnisat: Self-supervised modality fusion for earth observation
The diversity and complementarity of sensors available for Earth Observations (EO) calls for
develo** bespoke self-supervised multimodal learning approaches. However, current …
develo** bespoke self-supervised multimodal learning approaches. However, current …
Forecasting of 3D Whole-body Human Poses with Gras** Objects
In the context of computer vision and human-robot interaction forecasting 3D human poses
is crucial for understanding human behavior and enhancing the predictive capabilities of …
is crucial for understanding human behavior and enhancing the predictive capabilities of …
OmniVec2-A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning
S Srivastava, G Sharma - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We present a novel multimodal multitask network and associated training algorithm. The
method is capable of ingesting data from approximately 12 different modalities namely …
method is capable of ingesting data from approximately 12 different modalities namely …
Segment Beyond View: Handling Partially Missing Modality for Audio-Visual Semantic Segmentation
Augmented Reality (AR) devices, emerging as prominent mobile interaction platforms, face
challenges in user safety, particularly concerning oncoming vehicles. While some solutions …
challenges in user safety, particularly concerning oncoming vehicles. While some solutions …
User Engagement Triggers in Social Media Discourse on Biodiversity Conservation
Studies in digital conservation have increasingly used social media in recent years as a
source of data to understand the interactions between humans and nature, model and …
source of data to understand the interactions between humans and nature, model and …