- List of Common Acronyms Found in the <i>Handbook</i>
- List of Software Found in the <i>Handbook</i>
- List of Games Found in the <i>Handbook</i>
- List of Contributors
- About the Companion Website
- Spatial Reconfiguration in Interactive Video Art
- Navigating Sound: Locative and Translocational Approaches to Interactive Audio
- Defining Sound Toys: Play as Composition
- Thinking More Dynamically about Using Sound to Enhance Learning from Instructional Technologies
- Acoustic Scenography and Interactive Audio: Sound Design for Built Environments
- The Unanswered Question of Musical Meaning: A Cross-domain Approach
- How Can Interactive Music be Used in Virtual Worlds Like <i>World of Warcraft</i>?
- Sound and the Videoludic Experience
- Designing a Game for Music: Integrated Design Approaches for Ludic Music and Interactivity
- Worlds of Music: Strategies for Creating Music-based Experiences in Videogames
- Embodied Virtual Acoustic Ecologies of Computer Games
- A Cognitive Approach to the Emotional Function of Game Sound
- The Sound of Being There: Presence and Interactive Audio in Immersive Virtual Reality
- Sonic Interactions in Multimodal Environments: An Overview
- Musical Interaction for Health Improvement
- Engagement, Immersion and Presence: The Role of Audio Interactivity in Location-aware Sound Design
- Multisensory Musicality in <i>Dance Central</i>
- Interactivity and Liveness in Electroacoustic Concert Music
- Skill in Interactive Digital Music Systems
- Gesture in the Design of Interactive Sound Models
- Virtual Musicians and Machine Learning
- Musical Behavior and Amergence in Technoetic and Media Arts
- Flow of Creative Interaction with Digital Music Notations
- Blurring Boundaries: Trends and Implications in Audio Production Software Developments
- Delivering Interactive Experiences through the Emotional Adaptation of Automatically Composed Music
- A Review of Interactive Sound in Computer Games: Can Sound Affect the Motoric Behavior of a Player?
- Interactive Spectral Processing of Musical Audio
- Let’s Mix it Up: Interviews Exploring the Practical and Technical Challenges of Interactive Mixing in Games
- Our Interactive Audio Future
- For the Love of Chiptune
- Procedural Audio Theory and Practice
- Live Electronic Preparation: Interactive Timbral Practice
- New Tools for Interactive Audio, and What Good they Do
Abstract and Keywords
This chapter examines interactive sound from the perspective of multimodal interaction. Attention is focused on how sound can complement, enhance, or substitute for other sensorial modalities, specifically vision and audition. The first part of the chapter presents several examples from the field of multimodal perception and cognition and embodied interaction. The second part focuses on the importance of multimodality in the emerging field of sonic interaction design.
Stefania Serafin is Professor with special responsabilities in sound for multimodal environments in the Medialogy section at Aalborg University in Copenhagen. I teach and research on sound models and sound design for interactive media and multimodal interfaces.
Access to the complete content on Oxford Handbooks Online requires a subscription or purchase. Public users are able to search the site and view the abstracts and keywords for each book and chapter without a subscription.
If you have purchased a print title that contains an access token, please see the token for information about how to register your code.