id |
caadria2020_091 |
authors |
Ren, Yue and Zheng, Hao |
year |
2020 |
title |
The Spire of AI - Voxel-based 3D Neural Style Transfer |
doi |
https://doi.org/10.52842/conf.caadria.2020.2.619
|
source |
D. Holzer, W. Nakapan, A. Globa, I. Koh (eds.), RE: Anthropocene, Design in the Age of Humans - Proceedings of the 25th CAADRIA Conference - Volume 2, Chulalongkorn University, Bangkok, Thailand, 5-6 August 2020, pp. 619-628 |
summary |
In the architecture field, humans have mastered various skills for creating unique spatial experiences with unknown interplays between known contents and styles. Meanwhile, machine learning, as a popular tool for mapping different input factors and generating unpredictable outputs, links the similarity of the machine intelligence with the typical form-finding process. Style Transfer, therefore, is widely used in 2D visuals for mixing styles while inspiring the architecture field with new form-finding possibilities. Researchers have applied the algorithm in generating 2D renderings of buildings, limiting the results in 2D pixels rather than real full volume forms. Therefore, this paper aims to develop a voxel-based form generation methodology to extend the 3D architectural application of Style Transfer. Briefly, through cutting the original 3D model into multiple plans and apply them to the 2D style image, the stylized 2D results generated by Style Transfer are then abstracted and filtered as groups of pixel points in space. By adjusting the feature parameters with user customization and replacing pixel points with basic voxelization units, designers can easily recreate the original 3D geometries into different design styles, which proposes an intelligent way of finding new and inspiring 3D forms. |
keywords |
Form Finding; Machine Learning; Artificial Intelligence; Style Transfer |
series |
CAADRIA |
email |
|
full text |
file.pdf (5,016,095 bytes) |
references |
Content-type: text/plain
|
Gatys, L.A., Ecker, A.S. and Bethge, M. (2015)
A neural algorithm of artistic style
, arXiv preprint arXiv, 1508.06576, pp. 1-16
|
|
|
|
Kato, H., Ushiku, Y. and Harada, T. (2018)
Neural 3d mesh renderer
, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3907-3916
|
|
|
|
Kim, J., Jaeyeol, S. and Jin-Kook, L. (2019)
Approach to Auto-recognition of Design Elements for the Intelligent Management of Interior Pictures.
, Proceedings of CAADRIA 2019, Wellington, New Zealand
|
|
|
|
Kim, J., Jaeyeol, S. and Jin-Kook, L. (2019)
Recognizing and Classifying Unknown Object in BIM using 2D CNN.
, Proceedings of CAAD Futures 2019, Daejeon, Korea
|
|
|
|
Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2012)
Imagenet classification with deep convolutional neural networks
, Advances in neural information processing systems, pp. 1097-1105
|
|
|
|
LeCun, Y., Bengio, Y. and Hinton, G. (2015)
Deep learning
, Nature, 521(7553), pp. 436-444
|
|
|
|
LeCun, Y., Bottou, L., Bengio, Y. and et, al. (1988)
Gradient-based learning applied to document recognition
, Proceedings of the IEEE, 86(11), pp. 2278-2324
|
|
|
|
Ma, C., Huang, H., Sheffer, A. and et, al. (2014)
Analogy-driven 3D style transfer
, Computer Graphics Forum
|
|
|
|
Matias, D.C., Sandra, M., Marianne, S. and Leetee, W. (2018)
The Church of AI.
, Proceedings of CAADRIA 2019, Wellington, New Zealand
|
|
|
|
McCulloch, W.S. and Pitts, W. (1943)
A logical calculus of the ideas immanent in nervous activity.
, The bulletin of mathematical biophysics, 5(4), pp. 115-133
|
|
|
|
Ng, J.M.Y., Nariddh, K., Madden, D., Fabbri, A., Gardner, N., Haeusler, M.H. and Zavoleas, Y. (2019)
Optimising Image Classification
, Proceedings of CAADRIA 2019, Wellington, New Zealand
|
|
|
|
Simonyan, K. and Zisserman, A. (2014)
Very deep convolutional networks for large-scale image recognition
, arXiv preprint arXiv, 1409, p. 1556
|
|
|
|
Zheng, Y., Yang, C. and Merkulov, A. (2018)
Breast cancer screening using convolutional neural network and follow-up digital mam-mography
, Computational Imaging III. International Society for Optics and Photonics
|
|
|
|
last changed |
2022/06/07 07:56 |
|