Diffusion-guided reconstruction of everyday hand-object interaction clips

Y Ye, P Hebbar, A Gupta… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We tackle the task of reconstructing hand-object interactions from short video clips. Given an
input video, our approach casts 3D inference as a per-video optimization and recovers a …

Neural implicit representation for building digital twins of unknown articulated objects

Y Weng, B Wen, J Tremblay, V Blukis… - Proceedings of the …, 2024 - openaccess.thecvf.com
We address the problem of building digital twins of unknown articulated objects from two
RGBD scans of the object at different articulation states. We decompose the problem into …

Paris: Part-level reconstruction and motion analysis for articulated objects

J Liu, A Mahdavi-Amiri, M Savva - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We address the task of simultaneous part-level reconstruction and motion parameter
estimation for articulated objects. Given two sets of multi-view images of an object in two …

Carto: Category and joint agnostic reconstruction of articulated objects

N Heppert, MZ Irshad, S Zakharov… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present CARTO, a novel approach for reconstructing multiple articulated objects from a
single stereo RGB observation. We use implicit object-centric representations and learn a …

Reacto: Reconstructing articulated objects from a single video

C Song, J Wei, CS Foo, G Lin… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
In this paper we address the challenge of reconstructing general articulated 3D objects from
a single video. Existing works employing dynamic neural radiance fields have advanced the …

Editablenerf: Editing topologically varying neural radiance fields by key points

C Zheng, W Lin, F Xu - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a
challenging problem to edit the scenes modeled by NeRF-based methods, especially for …

Actorsnerf: Animatable few-shot human rendering with generalizable nerfs

J Mu, S Sang, N Vasconcelos… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
While NeRF-based human representations have shown impressive novel view synthesis
results, most methods still rely on a large number of images/views for training. In this work …

Nap: Neural 3d articulated object prior

J Lei, C Deng, WB Shen, LJ Guibas… - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract We propose Neural 3D Articulated object Prior (NAP), the first 3D deep generative
model to synthesize 3D articulated object models. Despite the extensive research on …

Recent Trends in 3D Reconstruction of General Non‐Rigid Scenes

R Yunus, JE Lenssen, M Niemeyer… - Computer Graphics …, 2024 - Wiley Online Library
Reconstructing models of the real world, including 3D geometry, appearance, and motion of
real scenes, is essential for computer graphics and computer vision. It enables the …

Arnold: A benchmark for language-grounded task learning with continuous states in realistic 3d scenes

R Gong, J Huang, Y Zhao, H Geng… - Proceedings of the …, 2023 - openaccess.thecvf.com
Understanding the continuous states of objects is essential for task learning and planning in
the real world. However, most existing task learning benchmarks assume discrete (eg …