Aligning cyber space with physical world: A comprehensive survey on embodied ai

Y Liu, W Chen, Y Bai, X Liang, G Li, W Gao… - arxiv preprint arxiv …, 2024 - arxiv.org
Embodied Artificial Intelligence (Embodied AI) is crucial for achieving Artificial General
Intelligence (AGI) and serves as a foundation for various applications that bridge cyberspace …

Transfer learning in robotics: An upcoming breakthrough? A review of promises and challenges

N Jaquier, MC Welle, A Gams, K Yao… - … Journal of Robotics …, 2023 - journals.sagepub.com
Transfer learning is a conceptually-enticing paradigm in pursuit of truly intelligent embodied
agents. The core concept—reusing prior knowledge to learn in and from novel situations—is …

Toward general-purpose robots via foundation models: A survey and meta-analysis

Y Hu, Q **e, V Jain, J Francis, J Patrikar… - arxiv preprint arxiv …, 2023 - arxiv.org
Building general-purpose robots that operate seamlessly in any environment, with any
object, and utilizing various skills to complete diverse tasks has been a long-standing goal in …

Bridging the Literacy Gap: A Multisensory Approach to Effective Intervention

P Vestal, OK Kilag, GG Alvez, D Escabas… - … disciplinary Journal of …, 2023 - multijournals.org
This systematic literature review and meta-analysis illuminate the transformative potential of
multisensory literacy instruction within the domain of literacy education. Drawing from a …

Core challenges in embodied vision-language planning

J Francis, N Kitamura, F Labelle, X Lu, I Navarro… - Journal of Artificial …, 2022 - jair.org
Recent advances in the areas of multimodal machine learning and artificial intelligence (AI)
have led to the development of challenging tasks at the intersection of Computer Vision …

Mosaic: Learning unified multi-sensory object property representations for robot learning via interactive perception

G Tatiya, J Francis, HH Wu, Y Bisk… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
A holistic understanding of object properties across diverse sensory modalities (eg, visual,
audio, and haptic) is essential for tasks ranging from object categorization to complex …

Multimodal embodied attribute learning by robots for object-centric action policies

X Zhang, S Amiri, J Sinapov, J Thomason, P Stone… - Autonomous …, 2023 - Springer
Robots frequently need to perceive object attributes, such as red, heavy, and empty, using
multimodal exploratory behaviors, such as look, lift, and shake. One possible way for robots …

Transformer-based material recognition via short-time contact sensing

Z Liu, Y Shao, Q Li, J Su - Pattern Recognition, 2025 - Elsevier
Embodied intelligence needs haptic sensing for spontaneous and accurate material
recognition. The haptic sensing module of an intelligent system can acquire material data …

Privileged Sensing Scaffolds Reinforcement Learning

ES Hu, J Springer, O Rybkin, D Jayaraman - arxiv preprint arxiv …, 2024 - arxiv.org
We need to look at our shoelaces as we first learn to tie them but having mastered this skill,
can do it from touch alone. We call this phenomenon" sensory scaffolding": observation …

Cross-tool and cross-behavior perceptual knowledge transfer for grounded object recognition

G Tatiya, J Francis, J Sinapov - arxiv preprint arxiv:2303.04023, 2023 - arxiv.org
Humans learn about objects via interaction and using multiple perceptions, such as vision,
sound, and touch. While vision can provide information about an object's appearance, non …