| id |
caadria2023_446 |
| authors |
Guida, George |
| year |
2023 |
| title |
Multimodal Architecture: Applications of Language in a Machine Learning Aided Design Process |
| doi |
https://doi.org/10.52842/conf.caadria.2023.2.561
|
| source |
Immanuel Koh, Dagmar Reinhardt, Mohammed Makki, Mona Khakhar, Nic Bao (eds.), HUMAN-CENTRIC - Proceedings of the 28th CAADRIA Conference, Ahmedabad, 18-24 March 2023, pp. 561–570 |
| summary |
Recent advances in Natural Language Processing (NLP) and Diffusion Models (DMs) are leading to a significant change in the way architecture is conceived. With capabilities that surpass those of current generative models, it is now possible to produce an unlimited number of high-quality images (Dhariwal and Nichol 2021). This opens up new opportunities for using synthetic images and marks a new phase in the creation of multimodal 3D forms, central to architectural concept design stages. Presented here are three methodologies of generation of meaningful 2D and 3D designs, merging text-to-image diffusion models Stable Diffusion, and DALL-E 2 with computational methods. These allow designers to intuitively navigate through a multimodal feedback loop of information originating from language and aided by artificial intelligence tools. This paper contributes to our understanding of machine-augmented design processes and the importance of intuitive user interfaces (UI) in enabling new dialogues between humans and machines. Through the creation of a prototype of an accessible UI, this exchange of information can empower designers, build trust in these tools, and increase control over the design process. |
| keywords |
Machine Learning, Diffusion Models, Concept Design, Semantics, User Interface, Design Agency |
| series |
CAADRIA |
| email |
gfguida@gmail.com |
| full text |
 file.pdf (2,631,092 bytes) |
| references |
Content-type: text/plain
|
Bernard, T. (1993)
 Modes of Inscription
, ANY: Architecture New York, Anyone Corporation. www.jstor.org/stable/41845559
|
|
|
|
|
Bonta, J. P. (1990)
Reading and Writing About Architecture
, Design Book Review, 18, 13
|
|
|
|
|
Campo, M. (2021)
Architecture, Language and Ai
, Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), 1, 211-22
|
|
|
|
|
Eptein, Z., Levine, S., G. Rand, D., & Rahwan, I. (2020)
Who Gets Credit for Ai-generated Art? Iscience
, IScience.
|
|
|
|
|
Forty, A. (2004)
Words and Buildings: a Vocabulary of Modern Architecture
, Thames & Hudson
|
|
|
|
|
Huang, J., Johanes, M., Kim, F. C., Doumpioti, C., & Holz, G.-C. (2021)
On Gans, Nlp and Architecture: Combining Human and Machine Intelligences for the Generation and Evaluation of Meaningful Designs
, Technology: Architecture + Design, 5(2), 27-224. Available at: https://doi.org/1.18/24751448.221.19676
|
|
|
|
|
Yang, Z., & Buehler, M. J. (2021)
Words to Matter: De Novo Architected Materials Design Using Transformer Neural Networks
, Frontiers in Materials, 8. Available at: https://www.frontiersin.org/articles/1.3389/fmat
|
|
|
|
| last changed |
2023/06/15 23:14 |
|
