Paralinguistic vocal control of interactive media: how untapped elements of voice might enhance the role of non-speech voice input in the user's experience of multimedia.

Doctoral thesis English OPEN
Al Hashimi, Sama'a

Much interactive media development, especially commercial development, implies the dominance of the visual modality, with sound as a limited supporting channel. The development of multimedia technologies such as augmented reality and virtual reality has further revealed a distinct partiality to visual media. Sound, however, and particularly voice, have many aspects which have yet to be adequately investigated. Exploration of these aspects may show that sound can, in some respects, be superior to graphics in creating immersive and expressive interactive experiences. With this in mind, this thesis investigates the use of non-speech voice characteristics as a complementary input mechanism in controlling multimedia applications. It presents a number of projects that employ the paralinguistic elements of voice as input to interactive media including both screen-based and physical systems. These projects are used as a means of exploring the factors that seem likely to affect users’ preferences and interaction patterns during non-speech voice control. This exploration forms the basis for an examination of potential roles for paralinguistic voice input. The research includes the conceptual and practical development of the projects and a set of evaluative studies. The work submitted for Ph.D. comprises practical projects (50 percent) and a written dissertation (50 percent). The thesis aims to advance understanding of how voice can be used both on its own and in combination with other input mechanisms in controlling multimedia applications. It offers a step forward in the attempts to integrate the paralinguistic components of voice as a complementary input mode to speech input applications in order to create a synergistic combination that might let the strengths of each mode overcome the weaknesses of the other.
  • References (6)

    2. Key Aspects of Voice…..……………………………..……..…14 5.1 The Role of Paralinguistic Vocalizations in Inducing Cathartic Experiences 5.2 The Role of Paralinguistic Vocalizations and Singing in Expressive Communication 5.3 The Role of Voice-Visualization in Voice and Speech Therapy 5.4 The Role of Paralinguistic Voice Input in Augmenting Awareness of Voice Characteristics in the Hearing-Impaired 5.5 The Role of Vocal Telekinesis in the Perception of Causality in Interactive Media 5.6 The Role of Paralinguistic Vocalizations in Transforming Users into Performers Tidwell, C. H. (2003) 'Non-Verbal Communication Modes', http://www.andrews.edu/~tidwell/lead689/NonVerbal.html (January, 2005).

    Tourette Syndrome Association (2005) 'Tourette Syndrome Fact Sheet', http://www.ninds.nih.gov/disorders/tourette/detail_tourette.htm#What%20is%20 Tourette%20syndrome? (April, 2005).

    Trehub, S. E. and Nakata, T. (2002) Emotion and music in infancy. Musicae Scientiae, pp.37-61.

    Unwin, M., Kenny, D.T. and Davis, P. J. (2002) The Effect of Singing on Mood.

    Psychology of Music, Vol. 30, No.2, pp.175-185.

    Useher, R. (2004) 'A Whistle a Day Keeps Globalization Away', http://www.time.com/time/europe/magazine/article/0,13005,901040726- 664985,00.html (December, 2004).

  • Metrics
    0
    views in OpenAIRE
    0
    views in local repository
    99
    downloads in local repository

    The information is available from the following content providers:

    From Number Of Views Number Of Downloads
    Middlesex University Research Repository - IRUS-UK 0 99
Share - Bookmark