| id |
caadria2022_322 |
| authors |
Lo, Chun-Yu and Hou, June-Hao |
| year |
2022 |
| title |
A Natural Human-Drone Interface For Better Spatial Presence Experiences |
| source |
Jeroen van Ameijde, Nicole Gardner, Kyung Hoon Hyun, Dan Luo, Urvi Sheth (eds.), POST-CARBON - Proceedings of the 27th CAADRIA Conference, Sydney, 9-15 April 2022, pp. 99-108 |
| doi |
https://doi.org/10.52842/conf.caadria.2022.1.099
|
| summary |
As many remote construction projects increase in size and complexity, being able to manage personnel schedules, delegate tasks, and check work progress can improve work efficiency and productivity. Hence, video conferencing and remote monitoring software have been attempting to pursue an immersive and intuitive experience, but with limited developments. To better achieve that, we propose a system with a natural user interface (NUI) that can offer a vivid experience, facilitating AEC personnel who is novice drone operator to interact with the Unmanned Aerial Vehicle (UAV) by voice instructions and body posture to conduct remote site surveying, monitoring, and inspections instead of physical visiting. In addition, the proposed system is capable of on-demand path planning and camera movements for various tasks and enhances the spatial experience. We integrate these techniques to develop a human-drone interface, including a VR simulator and a haptic vest system, which offer a perceivable experience of spatial presence for different purposes. Compared with other relative works, the proposed system allows users to actively control the viewing angle and movements in the remote space more intuitively. Moreover, drones can augment human vision and let users gain mobile autonomy. |
| keywords |
spatial presence, natural user interface, human-drone interaction, virtual reality, remote working, body posture recognition, speech recognition, SDG 9 |
| series |
CAADRIA |
| email |
|
| full text |
 file.pdf (744,526 bytes) |
| references |
Content-type: text/plain
|
Albeaino, G., Gheisari, M. & Franz, B. W. (2019)
 A systematic review of unmanned aerial vehicle application areas and technologies in the AEC domain
, J. Inf. Technol. Constr., 24(Jul), 381-405
|
|
|
|
|
Arafsha, F., Alam, K. M. & El Saddik, A. (2012)
EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion
, Paper presented at the 2012 international conference on innovations in information technology (IIT)
|
|
|
|
|
Barfield, W., Zeltzer, D., Sheridan, T. & Slater, M. (1995)
Presence and performance within virtual environments
, Virtual environments and advanced interface design, 473-513
|
|
|
|
|
Christenson, M., Ahmed, B. A. & Nassar, K. (2013)
A verbal communication game for architecture, engineering and construction students
, Paper presented at the American Society for Engineering Education North Midwest Section Conference
|
|
|
|
|
Dey, M., Frazis, H., Loewenstein, M. A. & Sun, H. (2020)
Ability to work from home
, Monthly Labor Review, 1-19
|
|
|
|
|
Dunsmoor, J. E. & Murphy, G. L. (2015)
Categories, concepts, and conditioning: how humans generalize fear
, Trends in cognitive sciences, 19(2), 73-77
|
|
|
|
|
Erat, O., Isop, W. A., Kalkofen, D. & Schmalstieg, D. (2018)
Drone-augmented human vision: Exocentric control for drones exploring hidden areas
, IEEE transactions on visualization and computer graphics, 24(4), 1437-1446
|
|
|
|
|
Fernandez, R. A. S., Sanchez-Lopez, J. L., Sampedro, C., Bavle, H., Molina, M. & Campoy, P. (2016)
Natural user interfaces for human-drone multi-modal interaction
, Paper presented at the 2016 International Conference on Unmanned Aircraft Systems (ICUAS)
|
|
|
|
|
Go, Y.-G., Kang, H.-S., Lee, J.-W., Yu, M.-S. & Choi, S.-M. (2021)
Multi-User Drone Flight Training in Mixed Reality
, Electronics, 10(20), 2521
|
|
|
|
|
Khenak, N., Vézien, J., Théry, D. & Bourdot, P. (2020)
Spatial Presence in Real and Remote Immersive Environments and the Effect of Multisensory Stimulation
, Presence, 27(3), 287-308
|
|
|
|
|
Macchini, M., Lortkipanidze, M., Schiano, F. & Floreano, D. (2021)
The Impact of Virtual Reality and Viewpoints in Body Motion Based Drone Teleoperation
, Paper presented at the 2021 IEEE Virtual Reality and 3D User Interfaces (VR)
|
|
|
|
|
Peschel, J. M. & Murphy, R. R. (2012)
On the human–machine interaction of unmanned aerial system mission specialists
, IEEE Transactions on Human-Machine Systems, 43(1), 53-62
|
|
|
|
|
Yam-Viramontes, B. A. & Mercado-Ravell, D. (2020)
Implementation of a Natural User Interface to Command a Drone
, Paper presented at the 2020 International Conference on Unmanned Aircraft Systems (ICUAS)
|
|
|
|
| last changed |
2022/07/22 07:34 |
|
