Foundations & trends in multimodal machine learning: Principles, challenges, and open questions

PP Liang, A Zadeh, LP Morency - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

How to train your robot with deep reinforcement learning: lessons we have learned

J Ibarz, J Tan, C Finn, M Kalakrishnan… - … Journal of Robotics …, 2021 - journals.sagepub.com
Deep reinforcement learning (RL) has emerged as a promising approach for autonomously
acquiring complex behaviors from low-level sensor observations. Although a large portion of …

Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

PP Liang, A Zadeh, LP Morency - ar** from object localization, object pose estimation to grasp estimation for parallel grippers: a review
G Du, K Wang, S Lian, K Zhao - Artificial Intelligence Review, 2021 - Springer
This paper presents a comprehensive survey on vision-based robotic gras**. We
conclude three key tasks during vision-based robotic gras**, which are object localization …

[HTML][HTML] Multibench: Multiscale benchmarks for multimodal representation learning

PP Liang, Y Lyu, X Fan, Z Wu, Y Cheng… - Advances in neural …, 2021 - ncbi.nlm.nih.gov
Learning multimodal representations involves integrating information from multiple
heterogeneous sources of data. It is a challenging yet crucial area with numerous real-world …

Incomplete multimodality-diffused emotion recognition

Y Wang, Y Li, Z Cui - Advances in Neural Information …, 2023 - proceedings.neurips.cc
Human multimodal emotion recognition (MER) aims to perceive and understand human
emotions via various heterogeneous modalities, such as language, vision, and acoustic …

Variable compliance control for robotic peg-in-hole assembly: A deep-reinforcement-learning approach

CC Beltran-Hernandez, D Petit, IG Ramirez-Alpizar… - Applied Sciences, 2020 - mdpi.com
Featured Application Assembly tasks with industrial robot manipulators. Abstract Industrial
robot manipulators are playing a significant role in modern manufacturing industries …