id |
caadria2018_049 |
authors |
Xu, Tongda, Wang, Dinglu, Yang, Mingyan, You, Xiaohui and Huang, Weixin |
year |
2018 |
title |
An Evolving Built Environment Prototype - A Prototype of Adaptive Built Environment Interacting with Electroencephalogram Supported by Reinforcement Learning |
doi |
https://doi.org/10.52842/conf.caadria.2018.2.207
|
source |
T. Fukuda, W. Huang, P. Janssen, K. Crolla, S. Alhadidi (eds.), Learning, Adapting and Prototyping - Proceedings of the 23rd CAADRIA Conference - Volume 2, Tsinghua University, Beijing, China, 17-19 May 2018, pp. 207-215 |
summary |
This paper proposes an environment prototype learning from people's Electroencephalogram (EEG) feedback in real-time. Instead of the widely adopted supervised learning method, a recently published affordable reinforcement learning model (PPO) is adopted to avoid bias from designers and to base the interaction on the subject and intelligent agent rather than between the designer and subject. In this way, development of interaction method towards a specific target is substantially accelerated. The target of this prototype is to keep the subject's alpha wave stable or decline, which indicated a more calming state, by intelligent decision of illumination state according to subject's EEG. The result is promising, a decent trained model could be gained within 500,000 steps facing this mid-complex environment. The target of keeping the alpha wave of subjects on a low or stable level purely by decision from computer agents is successfully reached. |
keywords |
Brain–computer interface; Reinforcement learning; Adaptive environment; Electroencephalogram; Mindfulness training |
series |
CAADRIA |
email |
|
full text |
file.pdf (4,259,590 bytes) |
references |
Content-type: text/plain
|
Andreani, S. and Sayegh, A. (2017)
Augmented Urban Experiences: Technologically Enhanced Design Research Methods for Revealing Hidden Qualities of the Built Environment
, Proceedings of the 37th Annual Conference of the Association for Computer Aided Design in Architecture, pp. 82-91
|
|
|
|
Chiang, Y.C., Li, D. and Jane, H.A. (2017)
Wild or tended nature? the effects of landscape location and vegetation density on physiological and psychological responses
, Landscape & Urban Planning, 167, pp. 72-83
|
|
|
|
Kalogianni, D. and Coyne, R. (2014)
Thinking about sound and space, Recording people
, eCAADe 2014 Volume 2
|
|
|
|
Konda, V. R. and Tsitsiklis, J. N. (2000)
Actor-critic algorithms
, Advances in neural information processing systems, pp. pp. 1008-1014
|
|
|
|
Lalor, E, Kelly, SP, Finucane, C, Burke, R, Reilly, RB and McDarby, G (2004)
Brain computer interface based on the steady-state VEP for immersive gaming control
, Biomedizinsche Tecknik, 49(1), pp. 63-64
|
|
|
|
Lin, Y.P., Wang, C.H., Wu, T.L., Jeng, S.K. and Chen, J.H. (2009)
EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine
, Acoustics, Speech and Signal Processing, pp. 489-492
|
|
|
|
Mavros, P., Coyne, R. and Roe, J. (2012)
Engaging the Brain-Implications of mobile EEG for spatial representation
, eCAADe 30 Volume 2 User Participation in Design
|
|
|
|
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G. and Petersen, S. (2015)
Human-level control through deep reinforcement learning
, Nature, 518, pp. 529-533
|
|
|
|
Murugappan, M. and Murugappan, S. (2013)
Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT)
, 2013 IEEE 9th International Colloquium on Signal Processing and its Applications, pp. 289-294
|
|
|
|
Ramirez, R. and Vamvakousis, Z. (2012)
Detecting Emotion from EEG Signals Using the Emotive Epoc Device.
, International Conference on Brain Informatics, Berlin, Heidelberg., pp. 175-184
|
|
|
|
Scherer, R, Schloegl, A, Lee, F, Bischof, H, Janša, J and Pfurtscheller, G (2007)
The self-paced Graz brain-computer interface: methods and applications
, Computational intelligence and neuroscience
|
|
|
|
Schulman, J., Dhariwal, F., Radford, P. and Klimov, O. (2017)
Proximal policy optimization algorithms
, arXiv preprint arXiv:1707.06347.
|
|
|
|
Shemesh, A., Bar, M. and Grobman, Y.J. (2015)
Space and human perception: exploring our reaction to different geometries of space. In Emerging Experience in Past, Present and Future of Digital Architecture.
, The 20th International Conference of the Association for Computer-Aided Architectural Design Research in Asia
|
|
|
|
Sourina, O and Liu, Y (2014)
EEG-enabled Affective Human-Computer Interfaces
, Universal Access in Human-Computer Interaction
|
|
|
|
Strehl, U, Leins, U, Goth, G, Klinger, C, Hinterberger, T and Birbaumer, N (2006)
Self-regulation of slow cortical potentials: a new treatment for children with attention-deficit/hyperactivity disorde
, Pediatrics, 118(5), pp. 1530-1540
|
|
|
|
Sutton, R.S. and Barto, A.G. (2016)
Reinforcement Learning: An Introduction
, The MIT Press, Cambridge, Massachusetts
|
|
|
|
Valenzi, S., Islam, T., Jurica, P. and Cichocki, A. (2014)
Individual Classification of Emotions Using EEG
, Journal of Biomedical Science and Engineering, 7, pp. 604-620
|
|
|
|
last changed |
2022/06/07 07:57 |
|