Projects per year
Abstract
Sound design has been a fundamental component of audiovisual storytelling in linear media. However, with recent technological developments and the shift towards non-linear and immersive media, things are rapidly changing. More sensory information is available and, at the same time, the user is gaining agency upon the narrative, being offered the possibility of navigating or making other decisions. These new characteristics of immersive environments bring new challenges to storytelling in interactive narratives and require new strategies and techniques for audiovisual narrative progression. Can technology offer an immersive environment where the user has the sensation of agency, of choice, where her actions are not mediated by evident controls but subliminally induced in a way that it is ensured that a narrative is being followed? Can sound be a subliminal element that induces attentional focus on the most relevant elements for the narrative, inducing storytelling and biasing search in an immersive non-linear audiovisual environment? Herein, we present a literature review that has been guided by this prospect. With these questions in view, we present our exploration process in finding possible answers and potential solution paths. We point out that consistency, in terms of coherency across sensory modalities and emotional matching may be a critical aspect. Finally, we consider that this review may open up new paths for experimental studies that could, in the future, provide new strategies in the practice of sound design in the context of non-linear media.
Original language | English |
---|---|
Pages (from-to) | 737-748 |
Number of pages | 12 |
Journal | Personal and Ubiquitous Computing |
Volume | 25 |
Issue number | 4 |
DOIs | |
Publication status | Published - Aug 2021 |
Keywords
- Audiovisual attention
- Cross-modal perception
- Sound design
Fingerprint
Dive into the research topics of 'Sound design inducing attention in the context of audiovisual immersive environments'. Together they form a unique fingerprint.Projects
- 1 Active
-
CITAR: Research Center for Science and Technology of the Arts
Vieira, E., Nobre da Silva Pais, A. M., Filipe, C., Serra, S., Baltazar, A., Lobo, C., Carmona, C. R., Sá, C., Sousa, G. V. E., Pereira, H. M., Neves, J., Teixeira, J., Gomes, J. A., Carvalho, J. V., Castro, L., Teixeira, L., Aguiar, M., Crespo, N., Camarneiro, N., Costa, P. R., Pestana, P. D., Alves, P., Kunz, S., Neves, S., Coutinho, V. M., Galán-Pérez, A., Rangel, A., Natálio, C. E. R. M., Henriques, F., Afonso Lopes, M. I., Bordalo, R. & Lamounier, S.
1/01/20 → 31/12/23
Project: Research