Multimodal image synthesis and editing: A survey and taxonomy

F Zhan, Y Yu, R Wu, J Zhang, S Lu, L Liu… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
As information exists in various modalities in real world, effective interaction and fusion
among multimodal information plays a key role for the creation and perception of multimodal …

[PDF][PDF] 3d gaussian splatting for real-time radiance field rendering.

B Kerbl, G Kopanas, T Leimkühler, G Drettakis - ACM Trans. Graph., 2023 - sgvr.kaist.ac.kr
[CS482] 3D Gaussian Splatting for Real-Time Radiance Field Rendering Page 1 3D Gaussian
Splatting for Real-Time Radiance Field Rendering November 20, 2023 Bernhard Kerbl …

Nerfstudio: A modular framework for neural radiance field development

M Tancik, E Weber, E Ng, R Li, B Yi, T Wang… - ACM SIGGRAPH 2023 …, 2023 - dl.acm.org
Neural Radiance Fields (NeRF) are a rapidly growing area of research with wide-ranging
applications in computer vision, graphics, robotics, and more. In order to streamline the …

Monosdf: Exploring monocular geometric cues for neural implicit surface reconstruction

Z Yu, S Peng, M Niemeyer, T Sattler… - Advances in neural …, 2022 - proceedings.neurips.cc
In recent years, neural implicit surface reconstruction methods have become popular for
multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these …

Decomposing nerf for editing via feature field distillation

S Kobayashi, E Matsumoto… - Advances in Neural …, 2022 - proceedings.neurips.cc
Emerging neural radiance fields (NeRF) are a promising scene representation for computer
graphics, enabling high-quality 3D reconstruction and novel view synthesis from image …

Freenerf: Improving few-shot neural rendering with free frequency regularization

J Yang, M Pavone, Y Wang - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Novel view synthesis with sparse inputs is a challenging problem for neural radiance fields
(NeRF). Recent efforts alleviate this challenge by introducing external supervision, such as …

Panoptic neural fields: A semantic object-aware neural scene representation

A Kundu, K Genova, X Yin, A Fathi… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present PanopticNeRF, an object-aware neural scene representation that decomposes
a scene into a set of objects (things) and background (stuff). Each object is represented by a …

3DFlex: determining structure and motion of flexible proteins from cryo-EM

A Punjani, DJ Fleet - Nature Methods, 2023 - nature.com
Modeling flexible macromolecules is one of the foremost challenges in single-particle
cryogenic-electron microscopy (cryo-EM), with the potential to illuminate fundamental …

Syncdreamer: Generating multiview-consistent images from a single-view image

Y Liu, C Lin, Z Zeng, X Long, L Liu, T Komura… - arxiv preprint arxiv …, 2023 - arxiv.org
In this paper, we present a novel diffusion model called that generates multiview-consistent
images from a single-view image. Using pretrained large-scale 2D diffusion models, recent …

3d neural field generation using triplane diffusion

JR Shue, ER Chan, R Po, Z Ankner… - Proceedings of the …, 2023 - openaccess.thecvf.com
Diffusion models have emerged as the state-of-the-art for image generation, among other
tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural …