| id |
ecaade2024_195 |
| authors |
Fukuda, Ryuto; Fukuda, Tomohiro; Yabuki, Nobuyoshi |
| year |
2024 |
| title |
Advancing Building Facade Inspection: Integration of an infrared camera-equipped drone and mixed reality |
| doi |
https://doi.org/10.52842/conf.ecaade.2024.2.139
|
| source |
Kontovourkis, O, Phocas, MC and Wurzer, G (eds.), Data-Driven Intelligence - Proceedings of the 42nd Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe 2024), Nicosia, 11-13 September 2024, Volume 2, pp. 139148 |
| summary |
Routine inspections of building facades are crucial to ensure structural safety and operational integrity. Recently, the use of drones equipped with infrared (IR) cameras has greatly improved inspection efficiency. However, determining exterior wall anomalies from infrared thermography is difficult for non-experts and requires simplified understanding and visualization. In this study, we propose a new system that combines a drone equipped with an IR camera and mixed reality (MR) technology. The system aims to detect and display likely defects in the building envelope in real time, and to display MR data simultaneously with past inspection data so that past and current conditions can be easily compared. In the proposed method, both an IR camera and an RGB camera are mounted on a drone. The average surface temperature is calculated from the captured IR video frame images, and a thresholding process is used to identify hot regions that indicate potential anomalies; MR is used to superimpose the detected anomalies on the RGB images, providing an intuitive visualization. By storing the detected areas on a wall surface in a virtual space, the MR display at the next inspection will also allow comparison with past inspection results. This study presents a comprehensive solution for advancing building façade inspections that combines drone technology, infrared imaging, and the efficiency of mixed reality to facilitate safer and more informed decision-making in building maintenance. |
| keywords |
Mixed Reality, Building Facade Inspection, Drone, Infrared Camera, Thermal Information Visualization |
| series |
eCAADe |
| email |
|
| full text |
 file.pdf (1,030,054 bytes) |
| references |
Content-type: text/plain
|
Balaras, C. A. & Argiriou, A. A. (2002)
 Infrared thermography for building diagnostics
, Energy and Buildings, 34(2), 171-183
|
|
|
|
|
BELCA, J. B. a. E. L.-L. C. A. (2023)
Periodic Inspection Manual for Exterior Tile Wall and Plaster Wall (Engl. Transl.), 4th edition
, Tokyo, Japan: Japan Building and Equipment Long-Life Cycle Association
|
|
|
|
|
Cao, Y., Dong, Y., Wang, F., Yang, J., Cao, Y. & Li, X. (2021)
Multi-sensor spatial augmented reality for visualizing the invisible thermal information of 3D objects
, Optics and Lasers in Engineering, 145, 106634
|
|
|
|
|
Cao, Y., Xu, B., Ye, Z., Yang, J., Cao, Y., Tisse, C.-L. & Li, X. (2018)
Depth and thermal sensor fusion to enhance 3D thermographic reconstruction
, Optics Express, 26(7), 8179-8193
|
|
|
|
|
Chin, R., Catal, C., & Kassahun, A. (2023)
Plant disease detection using drones in precision agriculture [Review]
, Precision Agriculture, 24(5), 1663-1682. https://doi.org/10.1007/s11119-023-10014-y
|
|
|
|
|
Cotiè, P., Kolariè, D., Bosiljkov, V. B., Bosiljkov, V. & Jaglièiĉ, Z. (2015)
Determination of the applicability and limits of void and delamination detection in concrete structures using infrared thermography
, NDT & E International, 74, 87-93
|
|
|
|
|
Demisse, G. G., Borrmann, D. & Nüchter, A. (2015)
Interpreting Thermal 3D Models of Indoor Environments for Energy Efficiency
, Journal of Intelligent & Robotic Systems, 77(1), 55-72
|
|
|
|
|
Garrido, I., Lagüela, S., Sfarra, S., Madruga, F. J., & Arias, P. (2019)
Automatic detection of moistures in different construction materials from thermographic images
, Journal of Thermal Analysis and Calorimetry, 138(2), 1649-1668. https://doi.org/10.1007/s10973-019-08264-y
|
|
|
|
|
Grinzato, E., Vavilov, V. & Kauppinen, T. (1998)
Quantitative infrared thermography in buildings
, Energy and Buildings, 29(1), 1-9
|
|
|
|
|
Hecht, E. (1998)
Optics
, Addison Wesley Longman
|
|
|
|
|
Hiasa, S., Birgul, R., Matsumoto, M. & Necati Catbas, F. (2018)
Experimental and numerical studies for suitable infrared thermography implementation on concrete bridge decks
, Measurement, 121, 144-159
|
|
|
|
|
Kikuchi, N., Fukuda, T. & Yabuki, N. (2022)
Future landscape visualization using a city digital twin: integration of augmented reality and drones with implementation of 3D model-based occlusion handling
, Journal of Computational Design and Engineering, 9(2), 837-856
|
|
|
|
|
Kim, C., Perilli, S., Sfarra, S., & Kim, E. J. (2024)
Detection of the surface coating of photovoltaic panels using drone-acquired thermal image sequences [Article]
, Journal of Thermal Analysis and Calorimetry, 149(8), 3443-3452. https://doi.org/10.1007/s10973-024-12902-5
|
|
|
|
|
Kimura, T., Zhang, T. & Fukuda, H. (2019)
A Proposal for the Development of a Building Management System for Extending the Lifespan of Housing Complexes in Japan
, Sustainability, 11(20)
|
|
|
|
|
Koch, V., Ritterbusch, S., Kopmann, A., Müller, M., Habel, T. & von Both, P. (2011)
Flying Augmented Reality Supporting planning and simulation analysis by combining mixed reality methods using multicopter and pattern recognition
, Proceedings of the International Conference on Education and Research in Computer Aided Architectural Design in Europe
|
|
|
|
|
Landmann, M., Heist, S., Dietrich, P., Lutzke, P., Gebhart, I., Templin, J., Kühmstedt, P., Tünnermann, A. & Notni, G. (2019)
High-speed 3D thermography
, Optics and Lasers in Engineering, 121, 448-455
|
|
|
|
|
Liu, D., Xia, X., Chen, J. & Li, S. (2021)
Integrating Building Information Model and Augmented Reality for Drone-Based Building Inspection
, Journal of Computing in Civil Engineering, 35(2)
|
|
|
|
|
Lourenço, T., Matias, L. & Faria, P. (2017)
Anomalies detection in adhesive wall tiling systems byinfrared thermography
, Construction and Building Materials, 148, 419-428
|
|
|
|
|
Mayer, Z., Epperlein, A., Vollmer, E., Volk, R. & Schultmann, F. (2023)
Investigating the Quality of UAV-Based Images for the Thermographic Analysis of Buildings
, Remote Sensing, 15(2)
|
|
|
|
|
Metzmacher, H., Wölki, D., Schmidt, C., Frisch, J. & van Treeck, C. (2018)
Real-time human skin temperature analysis using thermal image recognition for thermal comfort assessment
, Energy and Buildings, 158, 1063-1078
|
|
|
|
| last changed |
2024/11/17 22:05 |
|
