How do the soundtracks enhance immersion in computer games? --- A case study of《NieR:Automata》
How do adaptive music and audio design build up the believability of game worlds?
The purpose of this study was to investigate how soundtracks and audio design can contribute to the establishment of immersion in computer games. Another aim was to find out how the game audio works with the visual can intensify the emotional bonds between the players and the fictional world of games.
《NieR: Automata》, the Japanese action role-playing game, was the subject of this study. The score analysis of selected soundtracks and the related gameplay videos of five main endings (ABCDE) were scrutinised in this study.
Players' 'extention of self'
The Audio enhancement framework in SCI-model was proposed by this study as the research method, which can divide into three domains : Sensory immersion, Challenged-based immersion, and Imaginary immersion. The concept of Flow was distinguished from immersion in the study. Besides, theories from Michel Chion and Ernst Toch were utilised on inspecting the functionality of audio in multimedia and the music analysis. Finally, the embodied cognition approach was applied to examine imaginary immersion, whose findings suggested that the auditory realm of games is crucial to turns the characters as the player’s ‘extension of self’ to sense and react to the game world.
What is the role of soundtracks for immersion in computer games?
The results revealed that the immersion in computer games benefits from the ‘emotion-inducing’ function of soundtracks to make players identify with the scenario and characters in games. Next, it was discovered that spatial audio design combined with adaptive music can effectively elicit the player’s empathy with characters, which supports stronger emotional bonds and the believability of game world by providing high sensorimotor contingency.
The principal conclusion was that to evaluate the immersive level of a game is to assess how much it “renders the fidelity to our aural memory”, instead of how much it ‘preserve the fidelity to reality’. Lastly, it was found that players would immerse themselves further if the thematic depth is offered via the recursive structure of games.
Read the full research paper here. Scroll down for the Appendix content. For detailed score analysis, please click the soundtrack names or page number.
#1 MACHINE VILLAGE p.21-23
Gameplay 3: Machine Village firstly appears with soundtrack <17.Pascal>
▪ Chorus comes in after Pascal has shown his kindness.
▪ Satre: 'Do you believe that existence precedes essence?'
▪ 9S: 'Wait, they have genders?'
#9 ACCESS POINT p.143
Integrating players' free choice to game mechanics - Teleportation screen = Loading screen.
▪ The dialogues show the personality of avatars: A2, machines.
▪ Music changes its reverb when AccessPoint menu opens.