| id |
acadia20_228 |
| authors |
Alawadhi, Mohammad; Yan, Wei |
| year |
2020 |
| title |
BIM Hyperreality |
| doi |
https://doi.org/10.52842/conf.acadia.2020.1.228
|
| source |
ACADIA 2020: Distributed Proximities / Volume I: Technical Papers [Proceedings of the 40th Annual Conference of the Association of Computer Aided Design in Architecture (ACADIA) ISBN 978-0-578-95213-0]. Online and Global. 24-30 October 2020. edited by B. Slocum, V. Ago, S. Doyle, A. Marcus, M. Yablonina, and M. del Campo. 228-236. |
| summary |
Deep learning is expected to offer new opportunities and a new paradigm for the field of architecture. One such opportunity is teaching neural networks to visually understand architectural elements from the built environment. However, the availability of large training datasets is one of the biggest limitations of neural networks. Also, the vast majority of training data for visual recognition tasks is annotated by humans. In order to resolve this bottleneck, we present a concept of a hybrid system—using both building information modeling (BIM) and hyperrealistic (photorealistic) rendering—to synthesize datasets for training a neural network for building object recognition in photos. For generating our training dataset, BIMrAI, we used an existing BIM model and a corresponding photorealistically rendered model of the same building. We created methods for using renderings to train a deep learning model, trained a generative adversarial network (GAN) model using these methods, and tested the output model on real-world photos. For the specific case study presented in this paper, our results show that a neural network trained with synthetic data (i.e., photorealistic renderings and BIM-based semantic labels) can be used to identify building objects from photos without using photos in the training data. Future work can enhance the presented methods using available BIM models and renderings for more generalized mapping and description of photographed built environments. |
| series |
ACADIA |
| type |
paper |
| email |
|
| full text |
 file.pdf (2,373,758 bytes) |
| references |
Content-type: text/plain
|
Alawadhi, Mohammad, and Wei Yan (2018)
 Geometry from 3D Photogrammetry for Building Energy Modeling
, Proceedings of the 22th Conference of the Iberoamerican Society of Digital Graphics (SIGraDi), Sao Carlos, Brazil, November 7–9. Sao Paulo: Blucher, 5: 631–637. https://doi.org/10.5151/sigradi2018-1867
|
|
|
|
|
As, Imdat, Siddharth Pal, and Prithwish Basu (2018)
Artificial Intelligence in Architecture: Generating Conceptual Design via Deep Learning
, International Journal of Architectural Computing16 (4): 306–327. https://doi.org/10.1177/1478077118800982
|
|
|
|
|
Baudrillard, Jean (1995)
Simulacra and Simulation
, Translated by Sheila Faria Glaser. Ann Arbor: University of Michigan Press
|
|
|
|
|
Borji, Ali (2018)
Pros and Cons of GAN Evaluation Measures
, ArXiv:1802.03446 [Cs], October. http://arxiv.org/abs/1802.03446
|
|
|
|
|
Braun, Alex, and André Borrmann (2019)
Combining Inverse Photogrammetry and BIM for Automated Labeling of Construction Site Images for Machine Learning
, Automation in Construction 106 (October): 102879. https://doi.org/10.1016/j.autcon.2019.102879
|
|
|
|
|
Chaillou, Stanislas (2019)
AI + Architecture: Towards a New Approach
, Thesis, Harvard University Graduate School of Design
|
|
|
|
|
Georgakis, Georgios, Arsalan Mousavian, Alexander C. Berg, and Jana Kosecka (2017)
Synthesizing Training Data for Object Detection in Indoor Scenes
, ArXiv:1702.07836 [Cs], September. http://arxiv.org/abs/1702.07836
|
|
|
|
|
Goodfellow, Ian J., Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio (2014)
Generative Adversarial Networks
, ArXiv:1406.2661 [Cs, Stat], June. http://arxiv.org/abs/1406.2661
|
|
|
|
|
Goodfellow, Ian (2017)
NIPS 2016 Tutorial: Generative Adversarial Networks
, ArXiv:1701.00160 [Cs], April. http://arxiv.org/abs/1701.00160
|
|
|
|
|
Handa, Ankur, Viorica Patraucean, Vijay Badrinarayanan, Simon Stent, and Roberto Cipolla (2015)
SceneNet: Understanding Real World Indoor Scenes With Synthetic Data
, ArXiv:1511.07041 [Cs], November. http://arxiv.org/abs/1511.07041
|
|
|
|
|
Isola, Phillip, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros (2018)
Image-to-Image Translation with Conditional Adversarial Networks
, ArXiv:1611.07004 [Cs], November. http://arxiv.org/abs/1611.07004
|
|
|
|
|
Jégou, Simon, Michal Drozdzal, David Vazquez, Adriana Romero, and Yoshua Bengio (2017)
The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation
, ArXiv:1611.09326 [Cs], October. http://arxiv.org/abs/1611.09326
|
|
|
|
|
Kim, Jinsung, Jaeyeol Song, and Jin-Kook Lee (2019)
Inference of Relevant BIM Objects Using CNN for Visual-Input Based Auto-Modeling
, Proceedings of the 36th International Association for Automation and Robotics in Construction (ISARC), May, 393–398. https://doi.org/10.22260/ISARC2019/0053
|
|
|
|
|
Krijnen, Thomas, and Martin Tamke (2015)
Assessing Implicit Knowledge in BIM Models with Machine Learning
, Modelling Behaviour: Design Modelling Symposium 2015, edited by Mette Ramsgaard Thomsen, Martin Tamke, Christoph Gengnagel, Billie Faircloth, and Fabian Scheurer, 397–406. Cham: Springer. https://doi.org/10.1007/978-3-319-24208-8_33
|
|
|
|
|
Lempitsky, V., and D. Ivanov (2007)
Seamless Mosaicing of Image-Based Texture Maps
, Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, June 17–22, 1–6. https://doi.org/10.1109/CVPR.2007.383078
|
|
|
|
|
Lyu, S., and H. Farid (2005)
How Realistic Is Photorealistic?
, IEEE Transactions on Signal Processing 53 (2): 845–850. https://doi.org/10.1109/TSP.2004.839896
|
|
|
|
|
Mayer, Nikolaus, Eddy Ilg, Philipp Fischer, Caner Hazirbas, Daniel Cremers, Alexey Dosovitskiy, and Thomas Brox (2018)
What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?
, International Journal of Computer Vision (April). https://doi.org/10.1007/s11263-018-1082-6
|
|
|
|
|
Peng, Wenzhe, Fan Zhang, and Takehiko Nagakura (2017)
Machines’ Perception of Space: Employing 3D Isovist Methods and a Convolutional Neural Network in Architectural Space Classification
, ACADIA 2017: Disciplines and Disruption [Proceedings of the 37th Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA)], Cambridge, MA, 2–4 November 2017, edited by T. Nagakura, S. Tibbits, M. Ibanez, and C. Mueller, 474–481. CUMINCAD
|
|
|
|
|
Richter, Stephan R., Vibhav Vineet, Stefan Roth, and Vladlen Koltun (2016)
Playing for Data: Ground Truth from Computer Games
, ArXiv:1608.02192 [Cs], August. http://arxiv.org/abs/1608.02192
|
|
|
|
|
Salimans, Tim, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen (2016)
Improved Techniques for Training GANs
, ArXiv:1606.03498 [Cs], June. http://arxiv.org/abs/1606.03498
|
|
|
|
| last changed |
2023/10/22 12:06 |
|
