| id |
acadia23_v2_420 |
| authors |
Guida, George; Escobar, Daniel; Navarro, Carlos |
| year |
2023 |
| title |
3D Neural Synthesis: Gaining Control with Neural Radiance Fields |
| source |
ACADIA 2023: Habits of the Anthropocene: Scarcity and Abundance in a Post-Material Economy [Volume 2: Proceedings of the 43rd Annual Conference for the Association for Computer Aided Design in Architecture (ACADIA) ISBN 979-8-9891764-0-3]. Denver. 26-28 October 2023. edited by A. Crawford, N. Diniz, R. Beckett, J. Vanucchi, M. Swackhamer 420-428. |
| summary |
This research introduces a novel, 3D machine-learning, aided design approach for early design stages. Integrating language within a multimodal framework grants designers greater control and agency in generating 3D forms. The proposed method leverages Stable Diffusion and Runway's Gen1 through the generation of 3D Neural Radiance Fields (NeRFs), surpassing the limitations of 2D image-based outcomes in aiding the design process. This paper presents a flexible machine-learning workflow taught to students in a conference workshop, and outlines the multimodal methods used - between text, image, video, and NeRFs. The resultant NeRF design outcomes are contextualized within a Unity agent-based, virtual environment for architectural simulation, and are expe- rienced with real-time VFX augmentations. This hybridized design process ultimately highlights the importance of feedback loops and control within machine-learning, aided-design processes. |
| series |
ACADIA |
| type |
paper |
| email |
|
| full text |
 file.pdf (2,226,669 bytes) |
| references |
Content-type: text/plain
|
Alex Nichol, Heewoo Jun, Prafulla Dhariwal, Pamela Mishkin, and Mark Chen (2022)
 Point-E: A System for Generating 3D Point Clouds from Complex Prompts
, ArXiv:2212.08751 [Cs], December. https://arxiv.org/abs/2212.08751
|
|
|
|
|
Amit Raj, Srinivas Kaza, Ben Poole, Michael Niemeyer, Nataniel Ruiz, Ben Shiran, Zada Kfir, et al (2023)
DreamBooth3D: Subject-Driven Text-To-3D Generation
, https://arxiv.org/ pdf/2303.13508.pdf
|
|
|
|
|
Ayaan Haque, Matthew Tancik, Alexei Efros, Aleksander Holynski, Angjoo Kanazawa, and Nerf Scene (2023)
Instruct NeRF2NeRF: Editing 3D Scenes with Instructions
, ArXvi May. https://arxiv.org/pdf/2303.12789.pdf
|
|
|
|
|
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall (2022)
DreamFusion: Text-To3D Using 2D Diffusion
, ArXiv (Cornell University), September. Cornell University. doi:https://doi.org/10.48550/arxiv.2209.14988
|
|
|
|
|
Bernard Tschumi (1993)
Modes of Inscription
, ANY: Architecture
|
|
|
|
|
Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin (2023)
Magic3D: High-Resolution Text-To-3D Content Creation
, ArXiv (Cornell University), November. Cornell University. doi:https://doi.org/10.48550/arxiv.2211.10440
|
|
|
|
|
Daniel Escobar, Carlos Navarro, and Evangelia Papaspyrou (2023)
An Attention Economy Theme Park
, Human Centric Proceedings of the 28th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2023), 1:209–18. Hong Kong: The Association for Computer-Aided Architectural Design Research in Asia
|
|
|
|
|
Gabriela Ben, Melech Stan, Diana Wofk, Will Saxton, Jean Yu, Estelle Aflalo, Shao-Yen Tseng, Matthias Müller, and Vasudev Lal (2023)
LDM3D: Latent Diffusion Model for 3D Fabio Nonato Intel
, ArXvi. https://arxiv.org/pdf/2305.10853v2.pdf
|
|
|
|
|
George Guida (2023)
Multimodal Architecture: Applications of Language in Machine Learning Aided Design Process
, Human-Centric Proceedings of the 28th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2023), 2:561–71. Hong Kong: The Association for Computer-Aided Architectural Design Research in Asia
|
|
|
|
|
Heewoo Jun and Alex Nichol (2023)
Shap-E: Generating Conditional 3D Implicit Functions
, ArXiv.org. May 3. doi:https://doi.org/10.48550/arXiv.2305.02463
|
|
|
|
|
Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, and Joshua B. Tenenbaum (2017)
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
, ArXiv.org. January 4. doi:https://doi.org/10.48550/arXiv.1610.07584
|
|
|
|
|
Marian Kleineberg, Matthias Fey, and Frank Weichert (2020)
Adversarial Generation of Continuous Implicit Shape Representations
, ArXiv.org. March 26. doi:https://doi. org/10.48550/arXiv.2002.00349
|
|
|
|
|
Mattias Del Campo (2021)
Architecture,Language and AI - Language,Attentional Generative Adversarial Networks (AttnGAN) and Architecture Design
, PROJECTIONS-Proceedings of the 26th CAADRIA Conference, Hong Kong and Online
|
|
|
|
|
Patrick Esser, Johnathan Chiu, Parmida Atighehchian, Jonathan Granskog, and Anastasis Germanidis (2023)
Structure and Content-Guided Video Synthesis with Diffusion Models
, ArXvi February. doi:https://doi.org/10.48550/arxiv.2302.03011
|
|
|
|
|
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer (2022)
High-Resolution Image Synthesis with Latent Diffusion Models
, ArXiv:2112.10752 [Cs], April. https://arxiv.org/abs/2112.10752
|
|
|
|
|
Shermeen Yousif and Daniel Bolojan (2022)
Interconnectivity of Deep Learning Models in AIDriven Design Systems
, October. doi:https://doi.org/10.47330/dcio.2022.iqbe2166
|
|
|
|
| last changed |
2024/12/20 09:12 |
|
