| id |
ecaade2018_145 |
| authors |
Fukuda, Tomohiro, Zhu, Yuehan and Yabuki, Nobuyoshi |
| year |
2018 |
| title |
Point Cloud Stream on Spatial Mixed Reality - Toward Telepresence in Architectural Field |
| source |
Kepczynska-Walczak, A, Bialkowski, S (eds.), Computing for a better tomorrow - Proceedings of the 36th eCAADe Conference - Volume 2, Lodz University of Technology, Lodz, Poland, 19-21 September 2018, pp. 727-734 |
| doi |
https://doi.org/10.52842/conf.ecaade.2018.2.727
|
| summary |
In remote meetings that involve the study of buildings and cities, sharing three-dimensional (3D) virtual spatial of buildings and cities is just as necessary as sharing the appearances and voices of meeting participants. Because of this, system development and pilot projects have attempted to share 3D virtual models via the internet in real-time but is still insufficient compared with face-to-face meeting. Therefore, this research explores the applicability of a spatial mixed reality (MR) system that displays point cloud streams to realize 3D remote meeting in architecture and urban fields. MR is a new technology that enables 3D presentations of various information, combining the physical and virtual worlds. One MR method is telepresence, which is expected to give people a way to communicate remotely as if face to face in a realistic way. We first developed a MR system named PcsMR (Point cloud stream on mixed reality) to display point cloud streams. The PcsMR system's operation consists of generating and transferring a point cloud stream and then rendering a point cloud stream using MR. The PcsMR acquired the point cloud stream in real-time using Kinect for Windows v2 and transferred it to Microsoft HoloLens, which uses optical see-through MR. Then we constructed two prototypes based on PcsMR and carried out pilot projects. Through observing the experiments, application possibilities for architecture and urban fields are found in meetings and communications that share real-time 3D objects and include the movement of remote participants and objects. The proposed method was evaluated feasible and effective. |
| keywords |
Telepresence; Mixed reality; Point cloud stream; Remote meeting; Real time |
| series |
eCAADe |
| email |
|
| full text |
 file.pdf (12,772,018 bytes) |
| references |
Content-type: text/plain
|
Agarwal, S, Snavely, N, Simon, I, Seitz, SM and Szeliski, R (2009)
 Building Rome in a Day
, IEEE 12th International Conference on Computer Vision (ICCV), pp. 72-79
|
|
|
|
|
Beck, S, Kunert, A, Kulik, A and Froehlich, B (2013)
Immersive group-to-group telepresence
, Visualization and Computer Graphics, IEEE Transactions, 19(4), pp. 616-625
|
|
|
|
|
Buxton, W (1992)
Telepresence: integrating shared task and person spaces
, Proceedings of Graphics Interface, pp. 123-129
|
|
|
|
|
Datta, S and Beynon, D (2005)
A Computational Approach to the Reconstruction of Surface Geometry from Early Temple Superstructures
, International Journal of Architectural Computing, 3(4), pp. 471-486
|
|
|
|
|
Fukuda, T, Zhang, T and Yabuki, N (2012)
Availability of Mobile Augmented Reality System for Urban Landscape Simulation
, 9th International Conference CDVE 2012, Osaka, pp. 231-238
|
|
|
|
|
Hidaka, N, Michikawa, T, Motamedi, A, Yabuki, N and Fukuda, T (2018)
Polygonization of Point Cloud of Tunnels Using Lofting Operation
, International Journal of Automation Technology (IJAT), 12(3), pp. 356-368
|
|
|
|
|
Kowalski, M, Naruniec, J and Daniluk, M (2015)
LiveScan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors
, 3D Vision, 2015 International Conference on, Lyon, France
|
|
|
|
|
Marchand, EB, Han, X and Dorta, T (2017)
Immersive retrospection by video-photogrammetry
, Proceedings of the 35th eCAADe Conference, Vol. 2, Rome, pp. 729-738
|
|
|
|
|
Milgram, P, Takemura, H, Utsumi, A and Kishino, F (1994)
Augmented Reality: A Class of Displays on the Reality-Virtuality Continuum
, Proc. SPIE, Vol.2351, pp. 282-292
|
|
|
|
|
Nagakura, T, Tsai, D and Choi, J (2015)
Capturing history bit by bit - Architectural database of Photogrammetric Model and Panoramic Video
, Proceedings of the 33rd eCAADe Conference - Volume 1, Vienna, pp. 685-694
|
|
|
|
|
Orts-Escolano, S, Rhemann, C, Fanello, S, Chang, W, Kowdle, A, Degtyarev, Y, Kim, D, Davidson, PL, Khamis, S, Dou, M, Tankovich, V, Loop, C, Cai, Q, Chou, PA, Mennicken, S, Valentin, J, Pradeep, V, Wang, S, Kang, SB, Kohli, P, Lutchyn, Y, Keskin, C and Izadi, S (2016)
Holoportation: Virtual 3D Teleportation in Real-time
, Proc. of the 29th Annual Symposium on User Interface Software and Technology, pp. 741-754.
|
|
|
|
|
Shen, Z and Kawakami, M (2010)
An online visualization tool for Internet-based local townscape design
, Computers, Environment and Urban Systems, 34(2), pp. 104-116
|
|
|
|
|
Sun, L, Fukuda, T and Resch, B (2014)
A synchronous distributed cloud-based virtual reality meeting system for architectural and urban design
, Frontiers of Architectural Research, 3(4), pp. 348-357
|
|
|
|
| last changed |
2022/06/07 07:50 |
|
