Chat with the environment: Interactive multimodal perception using large language models

X Zhao, M Li, C Weber, MB Hafez… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
Programming robot behavior in a complex world faces challenges on multiple levels, from
dextrous low-level skills to high-level planning and reasoning. Recent pre-trained Large …

Advanced Power Converters and Learning in Diverse Robotic Innovation: A Review

R Singh, VSB Kurukuru, MA Khan - Energies, 2023 - mdpi.com
This paper provides a comprehensive review of the integration of advanced power
management systems and learning techniques in the field of robotics. It identifies the critical …

[HTML][HTML] Highly resilient aerogel/sponge nested structures assisted multimodal tactile sensory system for robotic embodied perception

Y Jiang, L Fan, H Wang, Z Luo, W Zhang, J Wang… - Nano Energy, 2024 - Elsevier
Large language models (LLMs) exhibit outstanding reasoning abilities when robots perform
tasks, but are limited to the passively receiving information and lack multi-feature perception …

A closer look at reward decomposition for high-level robotic explanations

W Lu, X Zhao, S Magg, M Gromniak… - … on Development and …, 2023 - ieeexplore.ieee.org
Explaining the behaviour of intelligent agents learned by reinforcement learning (RL) to
humans is challenging yet crucial due to their incomprehensible proprioceptive states …

Modeling Variation in Human Feedback with User Inputs: An Exploratory Methodology

J Huang, RM Aronson, ES Short - Proceedings of the 2024 ACM/IEEE …, 2024 - dl.acm.org
To expedite the development process of interactive reinforcement learning (IntRL)
algorithms, prior work often uses perfect oracles as simulated human teachers to furnish …

EValueAction: a proposal for policy evaluation in simulation to support interactive imitation learning

F Sibona, J Luijkx, B Van Der Heijden… - 2023 IEEE 21st …, 2023 - ieeexplore.ieee.org
The up-and-coming concept of Industry 5.0 fore-sees human-centric flexible production
lines, where collaborative robots support human workforce. In order to allow a seamless …

The Power of Combined Modalities in Interactive Robot Learning

H Beierling, AL Vollmer - arxiv preprint arxiv:2405.07817, 2024 - arxiv.org
This study contributes to the evolving field of robot learning in interaction with humans,
examining the impact of diverse input modalities on learning outcomes. It introduces the …

AP-VLM: Active Perception Enabled by Vision-Language Models

V Sripada, S Carter, F Guerin, A Ghalamzan - arxiv preprint arxiv …, 2024 - arxiv.org
Active perception enables robots to dynamically gather information by adjusting their
viewpoints, a crucial capability for interacting with complex, partially observable …

[PDF][PDF] Robots learn to behave: improving human-robot collaboration in flexible manufacturing applications

F Sibona - 2023 - core.ac.uk
It is undeniable that the development of humanity and technology has been closely
connected for decades. What was important before is no longer so. This is because, given …

[PDF][PDF] Advancing Human-Robot Collaboration: The Impact of Flexible Input Mechanisms

H Beierling, K Loos, R Helmert, AL Vollmer - mechanisms-hri.github.io
This position paper calls for an increase in the number and flexibility of input mechanisms in
user-robot interactions, highlighting their potential to enhance learning algorithms through …