Eye-tracking Film Music

Article English OPEN
Mera, M. ; Stumpf, S. (2014)

Film music scholars, composers, directors and audiences have always implicitly believed that music can help determine the focus of an audience’s visual attention, but researchers have not as yet been able to prove this empirically. Eye-tracking research—the process of measuring either the point of gaze or the motion of the eyes—has grown exponentially in recent years. This paper reports on a foundational, empirical eye-tracking study that examined the effects of contextual musical attributes on visual attention, emotion and user experience during exploration tasks in moving images. Our results show that music is able to direct how we see by switching attention to target foci more quickly as well as lengthening fixations, and that music can also encourage greater exploration of visual scenes outside targets. Our work contributes the first step in understanding how music shapes visual attention using eye-tracking techniques. We encourage wider adoption of this approach which has the potential to enhance understanding of the complex processes of audiovisual perception in action.
  • References (36)
    36 references, page 1 of 4

    Benedek, Joey and Trish Miner. “Measuring Desirability: New Methods for Evaluating Desirability in a Usability Lab Setting.” Proceedings from the Usability Professionals Association 2002, (2002): 8-12.

    Bradley, Margaret M. and Peter J. Lang. “Measuring Emotion: the Self-assessment Manikin and the Semantic Differential.” Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (1994): 49-59.

    Bradley, Margaret, Laura Miccoli, Miguel Escrig, and Peter Lang. “The Pupil as a Measure of Emotional Arousal and Autonomic Activation.” Psychophysiology 45, 4 (2008): 602- 607.

    Brodsky, Warren. “The Effects of Music Tempo on Simulated Driving Performance and Vehicular Control.” Transportation Research Part F: Traffic Psychology and Behaviour 4, 4 (2002): 219-241.

    Cauchard, Fabrice, James Cane, and Ulrich Weger. “Influence of Background Speech and Music in Interrupted Reading: An Eye-tracking Study.” Applied Cognitive Psychology 26, 3 (2012): 381-390.

    Chen, Mei-Ching , Pei-Luen Tsai, Yu-Tung Huan, and Keh-Chung Lin. “Pleasant Music Improves Visual Attention in Patients with Unilateral Neglect After Stroke.” Brain Injury 27, 1 (2013): 75-82.

    Cohen, Annabel. “Associationism and Musical Soundtrack Phenomena.” Contemporary Music Review 9, (1993): 163-178.

    __________. “Film Music: Perspectives from Cognitive Psychology.” In Music and Cinema, ed. James Buhler, Caryl Flinn, and David Neumeyer, 360-377. Hanover, NH: University Press of New England, 2000.

    __________. “Music Cognition and the Cognitive Psychology of Film Structure.” Canadian Psychology 43, 4 (2002): 215-232.

    __________. “How Music Influences the Interpretation of Film and Video: Approaches from Experimental Psychology.” In Perspectives in Systematic Musicology, eds. Roger Kendall and Roger Savage, 15-36. Los Angeles: University of California, 2005.

  • Metrics
    views in OpenAIRE
    views in local repository
    downloads in local repository

    The information is available from the following content providers:

    From Number Of Views Number Of Downloads
    City Research Online - IRUS-UK 0 522
Share - Bookmark