| id |
sigradi2022_53 |
| authors |
Stuart-Smith, Robert; Danahy, Patrick |
| year |
2022 |
| title |
3D Generative Design for Non-Experts: Multiview Perceptual Similarity with Agent-Based Reinforcement Learning |
| source |
Herrera, PC, Dreifuss-Serrano, C, Gómez, P, Arris-Calderon, LF, Critical Appropriations - Proceedings of the XXVI Conference of the Iberoamerican Society of Digital Graphics (SIGraDi 2022), Universidad Peruana de Ciencias Aplicadas, Lima, 7-11 November 2022 , pp. 115–126 |
| summary |
Advances in additive manufacturing allow architectural elements to be fabricated with increasingly complex geometrical designs, however, corresponding 3D design software requires substantial knowledge and skill to operate, limiting adoption by non-experts or people with disabilities. Established non-expert approaches typically constrain geometry, topology, or character to a pre-established configuration, rather than aligning to figural and aesthetic characteristics defined by a user. A methodology is proposed that enables a user to develop multi-manifold designs from sketches or images in several 3d camera projections. An agent-based design approach responds to computer vision analysis (CVA) and Deep Reinforcement Learning (RL) to design outcomes with perceptual similarity to user input images evaluated by Structural Similarity Indexing (SSIM). Several CVA and RL ratios were explored in training models and tested on untrained images to evaluate their effectiveness. Results demonstrate a combination of CVA and RL motion behavior can produce meshes with perceptual similarity to image content. |
| keywords |
Generative Design, Machine Learning, Agent-Based Systems, Non-Expert Design |
| series |
SIGraDi |
| email |
|
| full text |
 file.pdf (1,369,070 bytes) |
| references |
Content-type: text/plain
|
Akizuki, Y., Bernhard, M., Kakooee, R., Kladeftira, M., & Dillenburger, B. (2020)
 Generative modelling with design constraints: Reinforcement learning for object generation
, RE: Anthropocene, Design in the Age of Humans - Proceedings of the 25th International Conference on Computer-Aided Architectural Design Research in Asia, CAADRIA 2020, 1
|
|
|
|
|
Bolojan, D., & Vermisso, E. (2020)
Deep Learning as heuristic approach for architectural concept generation Creativity and Artificial Intelligence
, International Conference on Innovative Computing and Cloud Computing
|
|
|
|
|
Davies, E. R. (2017)
Computer Vision: Principles, Algorithms, Applications, Learning
, Elsevier Science
|
|
|
|
|
del Campo, M., Carlson, A., & Manninger, S. (2021)
Towards Hallucinating Machines - Designing with Computational Vision
, International Journal of Architectural Computing, 19(1). https://doi.org/10.1177/1478077120963366
|
|
|
|
|
Ham, H., Wesley, J., & Hendra. (2019)
Computer vision based 3D reconstruction?: A review
, International Journal of Electrical and Computer Engineering, 9(4). https://doi.org/10.11591/ijece.v9i4.pp2394-2402
|
|
|
|
|
Negroponte, N. (1972)
The Architecture Machine: Toward a More Human Environment
, Cambridge, MA: MIT Press
|
|
|
|
|
Rehm, M. C. (2019)
Complicit: The creation of and collaboration with intelligent machines
, Architectural Design, 89(2). https://doi.org/10.1002/ad.2417
|
|
|
|
|
Reynolds, C. W. (1999)
Steering behaviors for autonomous characters
, Game Developers Conference, 763-782.https://doi.org/10.1016/S0140-6736(07)61755-3
|
|
|
|
|
Soltani, A. A., Huang, H., Wu, J., Kulkarni, T. D., & Tenenbaum, J. B. (2017)
Synthesizing 3D shapes via modeling multi-view depth maps and silhouettes with deep generative networks
, Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017-January. https://doi.org/10.1109/CVPR.2017.269
|
|
|
|
|
Stuart-Smith, R., & Danahy, P. (2022)
Visual Character Analysis Within Algorithmic Design, Quantifying Aesthetics Relative To Structural And Geometric Design Criteria
, J. van Ameijde, N. Gardner, K. H. Hyun, D. Luo, & U. Sheth (Eds.), CAADRIA 2022, POST-CARBON - Proceedings of the 27th CAADRIA Conference - vol. 1, Sydney, 9-15 April 2022 (pp. 131-140)
|
|
|
|
|
Stuart-Smith, R., Danahy, P., & Rotta, N. R. la. (2020)
Topological and material formation
, Proceedings of the 40th Annual Conference of the Association for Computer Aided Design in Architecture: Distributed Proximities, ACADIA 2020, 1
|
|
|
|
|
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004)
Image quality assessment: From error visibility to structural similarity
, IEEE Transactions on Image Processing, 13(4). https://doi.org/10.1109/TIP.2003.819861
|
|
|
|
|
Wu, J., Zhang, C., Xue, T., Freeman, W. T., & Tenenbaum, J. B. (2016)
Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling
, Advances in Neural Information Processing Systems
|
|
|
|
|
Yousif, S., & Bolojan, D. (2021)
Deep-performance: Incorporating deep learning for automating building performance simulation in generative systems
, Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021, 1
|
|
|
|
| last changed |
2023/05/16 16:55 |
|
