You are here

AN APPROACH USING AFFECTIVE COMPUTING TO PREDICT INTERACTION QUALITY FROM CONVERSATIONS

Download pdf | Full Screen View

Date Issued:
2022
Abstract/Description:
John Gottman’s mathematical models have been shown to accurately predict a couple’s style of interaction using only the sentiments found in the couple’s conversations. I derived speaker sentiment slopes from 151 recorded dyadic audio conversations from the IEMOCAP dataset through an IBM Watson emotion recognition pipeline and assessed its accuracy as input for a Gottman model by comparing the cumulative speaker sentiment slope for each conversation produced from predicted emotion codes to that produced from groundtruth codes provided by IEMOCAP. Watson produced sentiment slopes strongly correlated with those produced by groundtruth emotion codes. An abbreviated pipeline was also assessed consisting just of the Watson textual emotion recognition model using IEMOCAP’s human transcriptions as input. It produced predicted sentiment slopes very strongly correlated with those produced by groundtruth. The research demonstrated that artificial intelligence has potential to be used to predict interaction quality from short samples of conversational data.
Title: AN APPROACH USING AFFECTIVE COMPUTING TO PREDICT INTERACTION QUALITY FROM CONVERSATIONS.
69 views
38 downloads
Name(s): Matic, Richard N. , author
Maniaci, Michael, Thesis advisor
Florida Atlantic University, Degree grantor
Department of Psychology
Charles E. Schmidt College of Science
Type of Resource: text
Genre: Electronic Thesis Or Dissertation
Date Created: 2022
Date Issued: 2022
Publisher: Florida Atlantic University
Place of Publication: Boca Raton, Fla.
Physical Form: application/pdf
Extent: 81 p.
Language(s): English
Abstract/Description: John Gottman’s mathematical models have been shown to accurately predict a couple’s style of interaction using only the sentiments found in the couple’s conversations. I derived speaker sentiment slopes from 151 recorded dyadic audio conversations from the IEMOCAP dataset through an IBM Watson emotion recognition pipeline and assessed its accuracy as input for a Gottman model by comparing the cumulative speaker sentiment slope for each conversation produced from predicted emotion codes to that produced from groundtruth codes provided by IEMOCAP. Watson produced sentiment slopes strongly correlated with those produced by groundtruth emotion codes. An abbreviated pipeline was also assessed consisting just of the Watson textual emotion recognition model using IEMOCAP’s human transcriptions as input. It produced predicted sentiment slopes very strongly correlated with those produced by groundtruth. The research demonstrated that artificial intelligence has potential to be used to predict interaction quality from short samples of conversational data.
Identifier: FA00014023 (IID)
Degree granted: Thesis (MA)--Florida Atlantic University, 2022.
Collection: FAU Electronic Theses and Dissertations Collection
Note(s): Includes bibliography.
Subject(s): Affective Computing
Emotion recognition
Artificial intelligence
Persistent Link to This Record: http://purl.flvc.org/fau/fd/FA00014023
Use and Reproduction: Copyright © is held by the author with permission granted to Florida Atlantic University to digitize, archive and distribute this item for non-profit research and educational purposes. Any reuse of this item in excess of fair use or other copyright exemptions requires permission of the copyright holder.
Use and Reproduction: http://rightsstatements.org/vocab/InC/1.0/
Host Institution: FAU
Is Part of Series: Florida Atlantic University Digital Library Collections.