You are here
AN APPROACH USING AFFECTIVE COMPUTING TO PREDICT INTERACTION QUALITY FROM CONVERSATIONS
- Date Issued:
- 2022
- Abstract/Description:
- John Gottman’s mathematical models have been shown to accurately predict a couple’s style of interaction using only the sentiments found in the couple’s conversations. I derived speaker sentiment slopes from 151 recorded dyadic audio conversations from the IEMOCAP dataset through an IBM Watson emotion recognition pipeline and assessed its accuracy as input for a Gottman model by comparing the cumulative speaker sentiment slope for each conversation produced from predicted emotion codes to that produced from groundtruth codes provided by IEMOCAP. Watson produced sentiment slopes strongly correlated with those produced by groundtruth emotion codes. An abbreviated pipeline was also assessed consisting just of the Watson textual emotion recognition model using IEMOCAP’s human transcriptions as input. It produced predicted sentiment slopes very strongly correlated with those produced by groundtruth. The research demonstrated that artificial intelligence has potential to be used to predict interaction quality from short samples of conversational data.
Title: | AN APPROACH USING AFFECTIVE COMPUTING TO PREDICT INTERACTION QUALITY FROM CONVERSATIONS. |
69 views
38 downloads |
---|---|---|
Name(s): |
Matic, Richard N. , author Maniaci, Michael, Thesis advisor Florida Atlantic University, Degree grantor Department of Psychology Charles E. Schmidt College of Science |
|
Type of Resource: | text | |
Genre: | Electronic Thesis Or Dissertation | |
Date Created: | 2022 | |
Date Issued: | 2022 | |
Publisher: | Florida Atlantic University | |
Place of Publication: | Boca Raton, Fla. | |
Physical Form: | application/pdf | |
Extent: | 81 p. | |
Language(s): | English | |
Abstract/Description: | John Gottman’s mathematical models have been shown to accurately predict a couple’s style of interaction using only the sentiments found in the couple’s conversations. I derived speaker sentiment slopes from 151 recorded dyadic audio conversations from the IEMOCAP dataset through an IBM Watson emotion recognition pipeline and assessed its accuracy as input for a Gottman model by comparing the cumulative speaker sentiment slope for each conversation produced from predicted emotion codes to that produced from groundtruth codes provided by IEMOCAP. Watson produced sentiment slopes strongly correlated with those produced by groundtruth emotion codes. An abbreviated pipeline was also assessed consisting just of the Watson textual emotion recognition model using IEMOCAP’s human transcriptions as input. It produced predicted sentiment slopes very strongly correlated with those produced by groundtruth. The research demonstrated that artificial intelligence has potential to be used to predict interaction quality from short samples of conversational data. | |
Identifier: | FA00014023 (IID) | |
Degree granted: | Thesis (MA)--Florida Atlantic University, 2022. | |
Collection: | FAU Electronic Theses and Dissertations Collection | |
Note(s): | Includes bibliography. | |
Subject(s): |
Affective Computing Emotion recognition Artificial intelligence |
|
Persistent Link to This Record: | http://purl.flvc.org/fau/fd/FA00014023 | |
Use and Reproduction: | Copyright © is held by the author with permission granted to Florida Atlantic University to digitize, archive and distribute this item for non-profit research and educational purposes. Any reuse of this item in excess of fair use or other copyright exemptions requires permission of the copyright holder. | |
Use and Reproduction: | http://rightsstatements.org/vocab/InC/1.0/ | |
Host Institution: | FAU | |
Is Part of Series: | Florida Atlantic University Digital Library Collections. |