On the use of multimodal cues for the prediction of degrees of involvement in spontaneous conversation
Catharine Oertel, Trinity College Dublin
Quantifying the degree of involvement of a group of participants in a conversation is a task which humans accomplish every day, but it is something that, as of yet, machines are unable to do. To provide machines with this capability, we investigated how multi-modal cues (prosody, gaze and blinking) can be used (individually and in combination) to predict speakers’ degree of involvement in spontaneous conversations. We also investigated how the dynamics of prosodic accommodation (entrainment) can inform about conversational partners’ involvement.