Multimodal image synthesis and editing: A survey and taxonomy

F Zhan, Y Yu, R Wu, J Zhang, S Lu, L Liu… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
As information exists in various modalities in real world, effective interaction and fusion
among multimodal information plays a key role for the creation and perception of multimodal …

Shap-e: Generating conditional 3d implicit functions

H Jun, A Nichol - arxiv preprint arxiv:2305.02463, 2023 - arxiv.org
We present Shap-E, a conditional generative model for 3D assets. Unlike recent work on 3D
generative models which produce a single output representation, Shap-E directly generates …

Gaussianeditor: Swift and controllable 3d editing with gaussian splatting

Y Chen, Z Chen, C Zhang, F Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract 3D editing plays a crucial role in many areas such as gaming and virtual reality.
Traditional 3D editing methods which rely on representations like meshes and point clouds …

Gaussianeditor: Editing 3d gaussians delicately with text instructions

J Wang, J Fang, X Zhang, L **e… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently impressive results have been achieved in 3D scene editing with text instructions
based on a 2D diffusion model. However current diffusion models primarily generate images …

Dreameditor: Text-driven 3d scene editing with neural fields

J Zhuang, C Wang, L Lin, L Liu, G Li - SIGGRAPH Asia 2023 Conference …, 2023 - dl.acm.org
Neural fields have achieved impressive advancements in view synthesis and scene
reconstruction. However, editing these neural fields remains challenging due to the implicit …

Vr-gs: A physical dynamics-aware interactive gaussian splatting system in virtual reality

Y Jiang, C Yu, T **e, X Li, Y Feng, H Wang… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
As 3D content becomes increasingly prevalent, there'sa growing focus on the development
of engagements with 3D virtual content. Unfortunately, traditional techniques for creating …

AIM 2024 sparse neural rendering challenge: Methods and results

M Nazarczuk, S Catley-Chandar, T Tanay… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper reviews the challenge on Sparse Neural Rendering that was part of the
Advances in Image Manipulation (AIM) workshop, held in conjunction with ECCV 2024. This …

Tip-editor: An accurate 3d editor following both text-prompts and image-prompts

J Zhuang, D Kang, YP Cao, G Li, L Lin… - ACM Transactions on …, 2024 - dl.acm.org
Text-driven 3D scene editing has gained significant attention owing to its convenience and
user-friendliness. However, existing methods still lack accurate control of the specified …

Dge: Direct gaussian 3d editing by consistent multi-view editing

M Chen, I Laina, A Vedaldi - European Conference on Computer Vision, 2024 - Springer
We consider the problem of editing 3D objects and scenes based on open-ended language
instructions. A common approach to this problem is to use a 2D image generator or editor to …

View-consistent 3d editing with gaussian splatting

Y Wang, X Yi, Z Wu, N Zhao, L Chen… - European Conference on …, 2024 - Springer
The advent of 3D Gaussian Splatting (3DGS) has revolutionized 3D editing, offering efficient,
high-fidelity rendering and enabling precise local manipulations. Currently, diffusion-based …