Neural 3d video synthesis from multi-view video

T Li, M Slavcheva, M Zollhoefer… - Proceedings of the …, 2022 - openaccess.thecvf.com
We propose a novel approach for 3D video synthesis that is able to represent multi-view
video recordings of a dynamic real-world scene in a compact, yet expressive representation …

DONeRF: Towards Real‐Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks

T Neff, P Stadlbauer, M Parger, A Kurz… - Computer Graphics …, 2021 - Wiley Online Library
The recent research explosion around implicit neural representations, such as NeRF, shows
that there is immense potential for implicitly storing high‐quality scene and lighting …

Mixed neural voxels for fast multi-view video synthesis

F Wang, S Tan, X Li, Z Tian… - Proceedings of the …, 2023 - openaccess.thecvf.com
Synthesizing high-fidelity videos from real-world multiview input is challenging due to the
complexities of real-world environments and high-dynamic movements. Previous works …

R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

H Wang, J Ren, Z Huang, K Olszewski, M Chai… - … on Computer Vision, 2022 - Springer
Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging
potential to represent complex scenes with neural networks. One major drawback of NeRF is …

Real-time neural radiance caching for path tracing

T Müller, F Rousselle, J Novák, A Keller - arxiv preprint arxiv:2106.12372, 2021 - arxiv.org
We present a real-time neural radiance caching method for path-traced global illumination.
Our system is designed to handle fully dynamic scenes, and makes no assumptions about …

Temporal interpolation is all you need for dynamic neural radiance fields

S Park, M Son, S Jang, YC Ahn… - Proceedings of the …, 2023 - openaccess.thecvf.com
Temporal interpolation often plays a crucial role to learn meaningful representations in
dynamic scenes. In this paper, we propose a novel method to train spatiotemporal neural …

Stopthepop: Sorted gaussian splatting for view-consistent real-time rendering

L Radl, M Steiner, M Parger, A Weinrauch… - ACM Transactions on …, 2024 - dl.acm.org
Gaussian Splatting has emerged as a prominent model for constructing 3D representations
from images across diverse domains. However, the efficiency of the 3D Gaussian Splatting …

Scalable neural video representations with learnable positional features

S Kim, S Yu, J Lee, J Shin - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Succinct representation of complex signals using coordinate-based neural representations
(CNRs) has seen great progress, and several recent efforts focus on extending them for …

Mirrorgaussian: Reflecting 3d gaussians for reconstructing mirror reflections

J Liu, X Tang, F Cheng, R Yang, Z Li, J Liu… - … on Computer Vision, 2024 - Springer
Abstract 3D Gaussian Splatting showcases notable advancements in photo-realistic and
real-time novel view synthesis. However, it faces challenges in modeling mirror reflections …

Generalizable neural performer: Learning robust radiance fields for human novel view synthesis

W Cheng, S Xu, J Piao, C Qian, W Wu, KY Lin… - arxiv preprint arxiv …, 2022 - arxiv.org
This work targets at using a general deep learning framework to synthesize free-viewpoint
images of arbitrary human performers, only requiring a sparse number of camera views as …