| id |
caadria2022_507 |
| authors |
Bolojan, Daniel, Vermisso, Emmanouil and Yousif, Shermeen |
| year |
2022 |
| title |
Is Language All We Need? A Query Into Architectural Semantics Using a Multimodal Generative Workflow |
| doi |
https://doi.org/10.52842/conf.caadria.2022.1.353
|
| source |
Jeroen van Ameijde, Nicole Gardner, Kyung Hoon Hyun, Dan Luo, Urvi Sheth (eds.), POST-CARBON - Proceedings of the 27th CAADRIA Conference, Sydney, 9-15 April 2022, pp. 353-362 |
| summary |
This project examines how interconnected artificial intelligence (AI)-assisted workflows can address the limitations of current language-based models and streamline machine-vision related tasks for architectural design. A precise relationship between text and visual feature representation is problematic and can lead to "ambiguity‚ in the interpretation of the morphological/tectonic complexity of a building. Textual representation of a design concept only addresses spatial complexity in a reductionist way, since the outcome of the design process is co-dependent on multiple interrelated systems, according to systems theory (Alexander 1968). We propose herewith a process of feature disentanglement (using low level features, i.e., composition) within an interconnected generative adversarial networks (GANs) workflow. The insertion of natural language models within the proposed workflow can help mitigate the semantic distance between different domains and guide the encoding of semantic information throughout a domain transfer process. |
| keywords |
Neural Language Models, GAN, Domain Transfer, Design Agency, Semantic Encoding, SDG 9 |
| series |
CAADRIA |
| email |
|
| full text |
 file.pdf (2,955,824 bytes) |
| references |
Content-type: text/plain
|
Alexander, C. (1968)
 Systems generating systems
, Architectural Design, 38, 605-610
|
|
|
|
|
Dhariwal, P. & Nichol, A. (2021)
Diffusion models beat gans on image synthesis
, arXiv preprint arXiv 2105.05233
|
|
|
|
|
Gero, J. S. (1990)
Design prototypes: a knowledge representation schema for design
, AI magazine, 11(4), 26-26
|
|
|
|
|
Gero, J. S. (1991)
Ten problems for AI in design
, Workshop on AI in Design, IJCAI-91
|
|
|
|
|
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S. & Bengio, Y. (2014)
Generative adversarial nets
, Advances in neural information processing systems, 27
|
|
|
|
|
Gregor, K., Danihelka, I., Graves, A., Rezende, D. & Wierstra, D. (2015)
Draw: A recurrent neural network for image generation
, International Conference on Machine Learning
|
|
|
|
|
Huang, J., Johanes, M., Kim, F. C., Doumpioti, C. & Holz, G.-C. (2021)
On GANs, NLP and Architecture: Combining Human and Machine Intelligences for the Generation and Evaluation of Meaningful Designs
, Technology| Architecture+ Design, 5(2), 207-224
|
|
|
|
|
Mansimov, E., Parisotto, E., Ba, J. L. & Salakhutdinov, R. (2015)
Generating images from captions with attention
, arXiv preprint arXiv:1511.02793
|
|
|
|
|
McCann, B., Bradbury, J., Xiong, C. & Socher, R. (2017)
Learned in translation: Contextualized word vectors
, arXiv preprint arXiv:1708.00107
|
|
|
|
|
Penrose, R. (1989)
The Emperor’s New Mind
, Oxford: Oxford University Press
|
|
|
|
|
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S. & Clark, J. (2021)
Learning transferable visual models from natural language supervision
, arXiv preprint arXiv:2103.00020
|
|
|
|
|
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A. & Sutskever, I. (2021)
Zero-shot text-to-image generation
, arXiv preprint arXiv:2102.12092
|
|
|
|
|
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B. & Lee, H. (2016)
Generative adversarial text to image synthesis
, International Conference on Machine Learning
|
|
|
|
|
Rodrigues, R. C., Alzate-Martinez, F. A., Escobar, D. & Mistry, M. (2021)
Rendering Conceptual Design Ideas with Artificial Intelligence: A Combinatory Framework of Text, Images and Sketches
, ACADIA 2021
|
|
|
|
|
Yang, Z. & Buehler, M. J. (2021)
Words to Matter: De novo Architected Materials Design Using Transformer Neural Networks
, Frontiers in Materials, 8(417). doi:10.3389/fmats.2021.740754
|
|
|
|
| last changed |
2022/07/22 07:34 |
|
