Doctoral colloquium: The application of established gestural languages in the control mappings of free-hand gestural musical instruments

Part of book or chapter of book English OPEN
Brown, D. (2016)
  • Publisher: University of Sussex
  • Subject:
    acm: InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI)

The “mapping problem” is a long standing issue in the development of digital musical instruments, and occurs when an instrument’s musical response fails to reflect the performer’s gestural actions. This paper describes ongoing doctoral research that seeks to address this issue by studying the existing gestural languages of Soundpainting and American Sign Language in order to influence the control mappings of free-hand gestural musical instruments. The research seeks to contribute a framework of mapping strategies influenced by these gestural languages, as well as developments in the field of gesture recognition algorithms and novel evaluation methods for free-hand gestural musical instruments.
  • References (32)
    32 references, page 1 of 4

    Barbosa, Jerônimo, Filipe Calegario, Veronica Teichrieb, Geber Ramalho, and Patrick McGlynn. 2012, May. “Considering Audience's View Towards an Evaluation Methodology for Digital Musical Instruments.” Proceedings of New Interfaces for Musical Expression (NIME). Ann Arbor, MI, USA.

    Bellotti, Victoria, Maribeth Back, W Keith Edwards, Rebecca E Grinter, Austin Henderson, and Cristina Lopes. 2002, April. “Making Sense of Sensing Systems: Five Questions for Designers and Researchers.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Minneapolis, MN, USA, 415-422.

    Bevilacqua, Frédéric, Bruno Zamborlin, Anthony Sypniewski, Norbert Schnell, Fabrice Guédy, and Nicolas Rasamimanana. 2010. “Continuous Realtime Gesture Following and Recognition.” In Gesture in Embodied Communication and Human-Computer Interaction, 73-84. Springer Berlin Heidelberg.

    Bobick, Aaron F, and Andrew D Wilson. 1997. “A State-Based Approach to the Representation and Recognition of Gesture.” IEEE Transactions on Pattern Analysis and Machine Intelligence 19 (12): 1325-1337.

    Caramiaux, Baptiste, Nicola Montecchio, Atau Tanaka, and Frédéric Bevilacqua. 2014. “Adaptive Gesture Recognition with Variation Estimation for Interactive Systems.” ACM Transactions on Interactive Intelligent Systems (TiiS) 4 (4): 18.

    Chandler, Daniel. 2007. Semiotics: the basics. Routledge.

    Dobrian, Christopher, and Daniel Koppelman. 2006, June. “The 'E' in NIME: Musical Expression with New Computer Interfaces.” Proceedings of New Interfaces for Musical Expression (NIME). Paris, France.

    Fels, Sidney, Ashley Gadd, and Axel Mulder. 2002. “Mapping Transparency Through Metaphor: Towards More Expressive Musical Instruments.” Organised Sound 7 (2): 109-126.

    Fyans, A Cavan, Michael Gurevich, and Paul Stapleton. 2009, April. “Spectator Understanding of Error in Performance.” CHI'09 Extended Abstracts on Human Factors in Computing Systems. ACM, Boston, MA, USA, 3955-3960.

    . 2010, June. “Examining the Spectator Experience.” Proceedings of New Interfaces for Musical Expression (NIME), Volume 10. Sydney, Australia, 1-4.

  • Metrics
    No metrics available
Share - Bookmark