Diffuscene: Denoising diffusion models for generative indoor scene synthesis

J Tang, Y Nie, L Markhasin, A Dai… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration
denoising diffusion model. It generates 3D instance properties stored in an unordered object …

3DALL-E: Integrating text-to-image AI in 3D design workflows

V Liu, J Vermeulen, G Fitzmaurice… - Proceedings of the 2023 …, 2023 - dl.acm.org
Text-to-image AI are capable of generating novel images for inspiration, but their
applications for 3D design workflows and how designers can build 3D models using AI …

MIME: Human-aware 3D scene generation

H Yi, CHP Huang, S Tripathi, L Hering… - Proceedings of the …, 2023 - openaccess.thecvf.com
Generating realistic 3D worlds occupied by moving humans has many applications in
games, architecture, and synthetic data creation. But generating such scenes is expensive …

Scenecraft: An llm agent for synthesizing 3d scenes as blender code

Z Hu, A Iscen, A Jain, T Kipf, Y Yue… - … on Machine Learning, 2024 - openreview.net
This paper introduces SceneCraft, a Large Language Model (LLM) Agent converting text
descriptions into Blender-executable Python scripts which render complex scenes with up to …

[HTML][HTML] Integration of convolutional and adversarial networks into building design: A review

J Parente, E Rodrigues, B Rangel, JP Martins - Journal of Building …, 2023 - Elsevier
Convolutional and adversarial networks are found in various fields of knowledge and
activities. One such field is building design, a multi-disciplinary and multi-task process …

Sceneformer: Indoor scene generation with transformers

X Wang, C Yeshwanth… - … Conference on 3D Vision …, 2021 - ieeexplore.ieee.org
We address the task of indoor scene generation by generating a sequence of objects, along
with their locations and orientations conditioned on a room layout. Large-scale indoor scene …

Anyhome: Open-vocabulary generation of structured and textured 3d homes

R Fu, Z Wen, Z Liu, S Sridhar - European Conference on Computer Vision, 2024 - Springer
Inspired by cognitive theories, we introduce AnyHome, a framework that translates any text
into well-structured and textured indoor scenes at a house-scale. By prompting Large …

Instructscene: Instruction-driven 3d indoor scene synthesis with semantic graph prior

C Lin, Y Mu - arxiv preprint arxiv:2402.04717, 2024 - arxiv.org
Comprehending natural language instructions is a charming property for 3D indoor scene
synthesis systems. Existing methods directly model object joint distributions and express …

Learning 3d scene priors with 2d supervision

Y Nie, A Dai, X Han, M Nießner - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Holistic 3D scene understanding entails estimation of both layout configuration and object
geometry in a 3D environment. Recent works have shown advances in 3D scene estimation …

[HTML][HTML] A review of multi-modal learning from the text-guided visual processing viewpoint

U Ullah, JS Lee, CH An, H Lee, SY Park, RH Baek… - Sensors, 2022 - mdpi.com
For decades, co-relating different data domains to attain the maximum potential of machines
has driven research, especially in neural networks. Similarly, text and visual data (images …