The role of sound in inducing storytelling in immersive environments

Inês Salselas, Rui Penha

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

19 Citations (Scopus)

Abstract

Sound design has been a fundamental component of audiovisual storytelling. However, with technological developments things are rapidly changing. More sensory information is available and, at the same time, the user is gaining agency upon the narrative, being offered the possibility of navigating or making other decisions. These new characteristics of immersive environments bring new challenges to storytelling in interactive narratives and require new strategies and techniques for audiovisual narrative progression. Can technology offer an immersive environment where the user has the sensation of agency, of choice, where her actions are not mediated by evident controls but subliminally induced in a way that it is ensured that a narrative is being followed? Can sound be a subliminal element that induces attentional focus on the most relevant elements for the narrative, inducing storytelling and biasing search in an audiovisual immersive environment? Herein, we present a literature review that has been guided by this prospect. With these questions in view, we present our exploration process in finding possible answers and potential solution paths. We point out that consistency, in terms coherency across sensory modalities and emotional matching may be a critical aspect.
Original languageEnglish
Title of host publicationProceedings of the 14th International Audio Mostly Conference
Subtitle of host publicationA Journey in Sound, AM 2019
PublisherAssociation for Computing Machinery, Inc
Pages191-198
Number of pages8
ISBN (Electronic)9781450372978
DOIs
Publication statusPublished - 18 Sept 2019
Externally publishedYes
Event14th International Audio Mostly Conference: A Journey in Sound, AM 2019 - Nottingham, United Kingdom
Duration: 18 Sept 201920 Sept 2019

Publication series

NameACM International Conference Proceeding Series

Conference

Conference14th International Audio Mostly Conference: A Journey in Sound, AM 2019
Country/TerritoryUnited Kingdom
CityNottingham
Period18/09/1920/09/19

Keywords

  • Audiovisual attention
  • Cross-modal perception
  • Sound

Fingerprint

Dive into the research topics of 'The role of sound in inducing storytelling in immersive environments'. Together they form a unique fingerprint.

Cite this