id |
2005_763 |
authors |
Beilharz, Kirsty |
year |
2005 |
title |
Architecture as the Computer Interface: 4D Gestural Interaction with Socio-Spatial Sonification |
doi |
https://doi.org/10.52842/conf.ecaade.2005.763
|
source |
Digital Design: The Quest for New Paradigms [23nd eCAADe Conference Proceedings / ISBN 0-9541183-3-2] Lisbon (Portugal) 21-24 September 2005, pp. 763-770 |
summary |
Architecture today extends far beyond designing building shells and material, peripheral boundaries. Arguably, it has always been, and shifts increasingly in contemporary environments towards, designing space and interaction with space. Hence, the role of the designer includes integration of computing in architecture through ambient display and non-tactile interaction. This paper explores a framework in which the architecture is the computer interface to information sonification. (Sonification is automatically generated representation of information using sound). The examples in this paper are Emergent Energies, demonstrating a socio-spatially responsive generative design in a sensate environment enabled by pressure mats; Sensor-Cow using wireless gesture controllers to sonify motion; and Sonic Kung Fu which is an interactive sound sculpture facilitated by video colour-tracking. The method in this paper connects current information sonification methodologies with gesture controller capabilities to complete a cycle in which gestural, non-tactile control permutes and interacts with automatically-generated information sonification. Gestural pervasive computing negotiates space and computer interaction without conventional interfaces (keyboard/mouse) thus freeing the user to monitor or display information with full mobility, without fixed or expensive devices. Integral computing, a blurring of human-machine boundaries and embedding communication infrastructure, ambient display and interaction in the fabric of architecture are the objectives of this re-thinking. |
keywords |
Interactive Sonification, Gesture Controllers, Responsive Spaces, SpatialSound |
series |
eCAADe |
email |
|
full text |
file.pdf (368,446 bytes) |
references |
Content-type: text/plain
|
Beilharz, K. (2004)
(Criteria & Aesthetics for) Mapping Social Behaviour to Real Time Generative Structures for Ambient Auditory Display (Interactive Sonification)
, E. Edmonds and R. Gibson (eds), INTERACTION - Systems, Practice and Theory: A Creativity & Cognition Symposium, Creativity and Cognition Press, The Dynamic Design Research Group, UTS, Sydney, pp. 75-102
|
|
|
|
Bongers, B. (2000)
Physical Interfaces in the Electronic Arts. Interaction Theory and Interfacing Techniques for Real-timePerformance
, W. W. Wanderley and M. Battier (eds), Trends in Gestural Control of Music, IRCAM - Centre Pompidou, Paris
|
|
|
|
Choi, I. (2000)
Gestural Primitives and the Context for Computational Processing in an Interactive Performance System
, W. W. Wanderley and M. Battier (eds), Trends in Gestural Control of Music, IRCAM (Institute of Research in Computer and Acoustic Music) Centre Pompidou, Paris
|
|
|
|
Ciardi, F. C. (2004)
sMAX: A Multimodal Toolkit for Stock Market Data Sonification
, S. Barrass and P. Vickers (eds), Proceedings of ICAD 04 -Tenth Meeting of the International Conference on Auditory Display, Sydney, Australia
|
|
|
|
Henry, C. (2004)
La Kitchen Kroonde Gamma - User Manual & Max Patches
, La Kitchen, Paris
|
|
|
|
Hunt, S. P. A. (2004)
A Toolkit for Interactive Sonification
, International Conference of Auditory Display (ICAD), Sydney, Australia
|
|
|
|
Maeda, J. (2004)
Creative Code
, Thames and Hudson, London
|
|
|
|
Nesbitt, K. V. and Barrass, S. (2002)
Evaluation of a Multimodal Sonification and Visualisation of Depth of Market Stock Data
, R. Nakatsu and H. Kawahara (eds), International Conference on Auditory Display (ICAD), Kyoto, Japan
|
|
|
|
Neuhoff, J. G., Kramer, G. and Wayand, J. (2000)
Sonification and the Interaction of Perceptual Dimensions: Can the Data Get Lost in the Map?
, P. R. Cook (eds), International Conference on Auditory Display, Atlanta, Georgia, USA
|
|
|
|
Pottier, L. and Stalla, O. (2000)
Interpretation and Space
, W. W. Wanderley and M. Battier (eds), Trends in Gestural Control of Music, IRCAM (Institute of Research in Computer and Acoustic Music) - Centre Pompidou, Paris
|
|
|
|
Rovan, J. and Hayward, V. (2000)
Typology of Tactile Sounds and their Synthesis in Gesture- Driven Computer Music Performance
, W. W. Wanderley and M. Battier (eds), Trends in Gestural Control of Music, IRCAM (Institute of Research in Computer and Acoustic Music) - Centre Pompidou, Paris
|
|
|
|
Song, H. J. and Beilharz, K. (2005)
Time-based Sonification for Information Representation
, World Multi-Conference on Systemics, Cybernetics and Informatics, Orlando, USA, pp. in press 28/01/05
|
|
|
|
Vickers, P. and Alty, J. L. (1998)
Towards some Organising Principles for Musical Program Auralisations
, A. Edwards and S. A. Brewster (eds), International Conference on Auditory Display (ICAD), Glasgow, Scotland, U.K
|
|
|
|
Walker, B. N. and Kramer, G. (1996)
Mappings and Metaphors in Auditory Displays: An Experimental Assessment
, International Conference on Auditory Display (ICAD), Palo Alto, California, USA
|
|
|
|
last changed |
2022/06/07 07:54 |
|