| id |
ecaade2020_120 |
| authors |
Ishikawa, Daichi, Fukuda, Tomohiro and Yabuki, Nobuyoshi |
| year |
2020 |
| title |
A Mixed Reality Coordinate System for Multiple HMD Users Manipulating Real-time Point Cloud Objects - Towards virtual and interactive 3D synchronous sharing of physical objects in teleconference during design study |
| source |
Werner, L and Koering, D (eds.), Anthropologic: Architecture and Fabrication in the cognitive age - Proceedings of the 38th eCAADe Conference - Volume 1, TU Berlin, Berlin, Germany, 16-18 September 2020, pp. 197-206 |
| doi |
https://doi.org/10.52842/conf.ecaade.2020.1.197
|
| summary |
Teleconferences without travel costs are useful for building a consensus in design. However, conventional teleconferencing using computer displays and web cameras is well known to have performance problems due to the lack of co-presence feeling with remote participants and the difficulty in sharing three dimensional (3D) information intuitively. This research proposes a method to share the mixed reality (MR) coordinate system for multiple head-mounted display (HMD) users manipulating real-time point cloud objects for the virtual and interactive 3D synchronous sharing in teleconferences. In our proposed method, the reference point of the virtual world coordinate system called world anchor and local coordinates of segmented point cloud objects in real-time are shared among HMDs via a server PC to share the same MR coordinate system. Using this method, the result of moving and rotating manipulation using hand gestures for segmented point cloud objects by an HMD user are reflected in the other HMD users. We developed a prototype system and evaluated the performance of the system when multiple users used this system. Future works include adapting this system to multiple RGB-D cameras and the internet environment. |
| keywords |
Mixed reality coordinate system; Real-time point clouds; Multiple User Interaction; Teleconference; 3D Synchronous Physical Object Sharing |
| series |
eCAADe |
| email |
|
| full text |
 file.pdf (6,415,418 bytes) |
| references |
Content-type: text/plain
|
Adler, D (eds) (1999)
 Metric Handbook Planning and Design Data (Second edition)
, Architectural Press
|
|
|
|
|
Draper, JV, Kaber, DB and Usher, JM (1998)
Telepresence
, Human Factors, 40(3), pp. 354-375
|
|
|
|
|
Du, J, Zou, Z, Shi, Y and Zhao, D (2018)
Zero latency: Real-time synchronization of BIM data in virtual reality for collaborative decision-making
, Automation in Construction, 85, pp. 51-64
|
|
|
|
|
Fischler, MA and Bolles, RC (1981)
Random sample consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography
, Communications of the ACM, 24(6), pp. 381-395
|
|
|
|
|
Fukuda, T, Zhu, Y and Yabuki, N (2018)
Point Cloud Stream on Spatial Mixed Reality - Toward Telepresence in Architectural Field
, Proceedings of the 36th eCAADe Conference (Education and Research in Computer Aided Architectural Design in Europe), Lodz, pp. 737-744
|
|
|
|
|
Henry, P, Krainin, M, Herbst, E, Ren, X and Fox, D (2012)
RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
, International Journal of Robotics Research, 31(5), pp. 647-663
|
|
|
|
|
Hollan, J and Stornetta, S (1992)
Beyond being there
, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Monterey, pp. 119-125
|
|
|
|
|
Innes, JE (1996)
A new view of the comprehensive planning ideal
, Journal of the American Planning ｓAssociation, 62(4), pp. 460-472
|
|
|
|
|
Ishikawa, D, Fukuda, T and Yabuki, N (2019)
Development of a Telepresence System for Sharing 3D Physical Objects Using Real-time Point Clouds
, Summaries of Technical Papers of Annual Meeting, Ishikawa, pp. 13-14
|
|
|
|
|
Kantonen, T, Woodward, C and Katz, N (2010)
Mixed reality in virtual world teleconferencing
, 2010 IEEE Virtual Reality Conference (VR), Waltham, pp. 179-182
|
|
|
|
|
Kieferle, J and Woessner, U (2015)
BIM Interactive - About combining BIM and Virtual Reality - A Bidirectional Interaction Method for BIM Models in Different Environments
, Proceedings of the 33rd eCAADe Conference, Vienna, pp. 69-75
|
|
|
|
|
Kowalski, M, Naruniec, J and Daniluk, M (2015)
Live Scan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors
, Proceedings - 2015 International Conference on 3D Vision, 3DV 2015, Lyon, pp. 318-325
|
|
|
|
|
McVeigh-Schultz, J, Kolesnichenko, A and Isbister, K (2019)
Shaping pro-social interaction in VR an emerging design framework
, Conference on Human Factors in Computing Systems - Proceedings, Glasgow, pp. 1-12
|
|
|
|
|
Rusu, RB (2010)
Semantic 3d object maps for everyday manipulation in human living environments
, KI-Künstliche Intelligenz, 24(4), pp. 345-348
|
|
|
|
| last changed |
2022/06/07 07:50 |
|
