publication . Doctoral thesis . 2016

Modelling Engagement in Multi-Party Conversations : Data-Driven Approaches to Understanding Human-Human Communication Patterns for Use in Human-Robot Interactions

Oertel, Catharine;
Open Access English
  • Published: 01 Jan 2016
  • Publisher: KTH, Tal, musik och hörsel, TMH
  • Country: Sweden
The aim of this thesis is to study human-human interaction in order to provide virtual agents and robots with the capability to engage into multi-party-conversations in a human-like-manner. The focus lies with the modelling of conversational dynamics and the appropriate realization of multi-modal feedback behaviour. For such an undertaking, it is important to understand how human-human communication unfolds in varying contexts and constellations over time. To this end, multi-modal human-human corpora are designed as well as annotation schemes to capture conversational dynamics are developed. Multi-modal analysis is carried out and models are built. Emphasis is p...
free text keywords: Engineering and Technology, Teknik och teknologier
Related Organizations
Download from
166 references, page 1 of 12

Gustafson, J., & Heldner, M. (2013b). The

2013, Edingburgh, UK.

Study X Oertel, C., Mora, K. A. F., Sheikhi, S., Odobez, J.-M., & Gustafson, J. (2014). Who Will Get the Grant?: A Multimodal Corpus for the Analysis of Conversational Behaviours in Group Interviews. Paper presented at the 2014 workshop on Understanding and Modeling Multiparty, Multimodal Interactions. [OpenAIRE]

Al Moubayed, S., Beskow, J., Bollepalli, B., Gustafson, J., HussenAbdelaziz, A., Johansson, M., . . . Varol, G. (2014). Humanrobot collaborative tutoring using multiparty multimodal spoken dialogue. Paper presented at the 2014 ACM/IEEE international conference on Human-robot interaction, Bielefeld, Germany. [OpenAIRE]

Al Moubayed, S., Beskow, J., Bollepalli, B., Hussen-Abdelaziz, A., Johansson, M., Koutsombogera, M., . . . Skantze, G. (2013). Tutoring Robots. Paper presented at the International Summer Workshop on Multimodal Interfaces, Bilbao, Spain.

Altmann, U., Oertel, C., & Campbell, N. (2012). Conversational involvement and synchronous nonverbal behaviour. In A. Esposito, A. Vinciarelli, R. Hoffmann, & V. Müller (Eds.), Cognitive Behavioural Systems. Lecture Notes in Computer Science (pp. 343--352): Springer. [OpenAIRE]

De Looze, C., Oertel, C., Rauzy, S., & Campbell, N. (2011). Measuring dynamics of mimicry by means of prosodic cues in conversational speech. Paper presented at the ICPhS 2011, Hong Kong, China. [OpenAIRE]

Edlund, J., Oertel, C., & Gustafson, J. (2012). Investigating negotiation for load-time in the GetHomeSafe project. Paper presented at the Workshop on Innovation and Applications in Speech Technology (IAST), Dublin, Ireland.

Han, J. G., Dalton, J., Vaughan, B., Oertel, C., Dougherty, C., De Looze, C., & Campbell, N. (2011). Collecting multi-modal data of human-robot interaction. Paper presented at the Cognitive Infocommunications (CogInfoCom), Budapest, Hungary.

Koutsombogera, M., Al Moubayed, S., Bollepalli, B., Hussen, A., Oertel, C., Stefanov, K., & Varol, G. (2014). The Tutorbot Corpus―A Corpus for Studying Tutoring Behaviour in Multiparty Face-to-Face Spoken Dialogue. Paper presented at the LREC 2014. [OpenAIRE]

Oertel, C. (2013). Towards developing a model for group involvement and individual engagement. Paper presented at the Doctoral Consortium at ICMI 2013, Syndney, Australia.

Oertel, C., Cummins, F., Campbell, N., Edlund, J., & Wagner, P. (2010). D64: A Corpus of Richly Recorded Conversational Interaction. Paper presented at the Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, Valetta, Malta.

Oertel, C., Looze, C. D., Vaughan, B., Gilmartin, E., & Wagner, P. (2011a). Using Hotspots as a Novel Method for Accessing Key Events in a Large Multi-Modal Corpus. Paper presented at the New Tools and Methods for Very-Large-Scale Phonetics Research, Pennsylvania, USA. [OpenAIRE]

Oertel, C., Scherer, S., & Campbell, N. (2011b). On the use of multimodal cues for the prediction of involvement in spontaneous conversation. Paper presented at the Interspeech, Florence, Italy.

Oertel, C., Wlodarczak, M., Edlund, J., Wagner, P., & Gustafson, J. (2012a). Gaze Patterns in Turn-Taking. Paper presented at the Interspeech 2012, Portland, USA.

166 references, page 1 of 12
Powered by OpenAIRE Research Graph
Any information missing or wrong?Report an Issue