Ghost-in-the-machine reveals human social signals for human-robot interaction

Article English OPEN
Loth, S. ; Jettka, K. ; Giuliani, M. ; De Ruiter, J. P. (2015)
  • Publisher: Frontiers Media SA
  • Journal: volume 6 (issn: 1664-1078, eissn: 1664-1078)
  • Related identifiers: pmc: PMC4631814, doi: 10.3389/fpsyg.2015.01641
  • Subject: Psychology | human–robot interaction | social behavior | eye tracking | Original Research | social signals | intention recognition | interaction strategies
    • ddc: ddc:410

We used a new method called “Ghost-in-the-Machine” (GiM) to investigate social interactions with a robotic bartender taking orders for drinks and serving them. Using the GiM paradigm allowed us to identify how human participants recognize the intentions of customers on the basis of the output of the robotic recognizers. Specifically, we measured which recognizer modalities (e.g., speech, the distance to the bar) were relevant at different stages of the interaction. This provided insights into human social behavior necessary for the development of socially competent robots. When initiating the drink-order interaction, the most important recognizers were those based on computer vision. When drink orders were being placed, however, the most important information source was the speech recognition. Interestingly, the participants used only a subset of the available information, focussing only on a few relevant recognizers while ignoring others. This reduced the risk of acting on erroneous sensor data and enabled them to complete service interactions more swiftly than a robot using all available sensor data. We also investigated socially appropriate response strategies. In their responses, the participants preferred to use the same modality as the customer’s requests, e.g., they tended to respond verbally to verbal requests. Also, they added redundancy to their responses, for instance by using echo questions. We argue that incorporating the social strategies discovered with the GiM paradigm in multimodal grammars of human–robot interactions improves the robustness and the ease-of-use of these interactions, and therefore provides a smoother user experience.
  • References (86)
    86 references, page 1 of 9

    Abelson R. P. (1981). Psychological status of the script concept. Am. Psychol. 36 715–729.

    Abernethy B. Maxwell J. P. Jackson R. C. Masters R. S. W. (2007). “Skill in sport,” in Handbook of Applied Cognition, eds Durso F. T. Nickerson R. S. Dumais S. T. Lewandowsky S. Perfect T. J. (Chichester: John Wiley & Sons Ltd.), 333–359.

    Admoni H. Dragan A. Srinivasa S. S. Scassellati B. (2014). “Deliberate delays during robot-to-human handovers improve compliance with gaze communication,” in Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interactio n (Bielefeld: ACM Press), 49–56. 10.1145/2559636.2559682

    Allport D. A. Antonis B. Reynolds P. (1972). On the division of attention: adisproof of the single channel hypothesis. Q. J. Exp. Psychol. 24 225–235. 10.1080/00335557243000102

    Argyle M. Dean J. (1965). Eye-Contact, distance and affiliation. Sociometry 28 289–304. 10.2307/2786027

    Baltzakis H. Pateraki M. Trahanias P. (2012). Visual tracking of hands, faces and facial features of multiple persons. Mach. Vis. Appl. 23 1141–1157. 10.1007/s00138-012-0409-5

    Bohus D. Horvitz E. (2009a). “Dialog in the open world: platform and applications,” in Proceedings of the 2009 International Conference on Multimodal Interfaces (ICMI-MLMI) (Cambridge, MA: ACM Press), 31. 10.1145/1647314.1647323

    Bohus D. Horvitz E. (2009b). “Learning to predict engagement with a spoken dialog system in open-world settings,” in Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue (London: Association for Computational Linguistics), 244–252.

    Bohus D. Horvitz E. (2009c). “Models for multiparty engagement in open-world dialog,” in Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue (London: Association for Computational Linguistics), 225–234.

    Bohus D. Horvitz E. (2009d). “Open-world dialog: challenges, directions, and prototype,” in Proceedings of the IJCAI’2009 Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Pasadena, CA.

  • Similar Research Results (1)
  • Metrics
    No metrics available
Share - Bookmark