You are here

DEEP LEARNING OF POSTURAL AND OCULAR DYNAMICS TO PREDICT ENGAGEMENT AND LEARNING OF AUDIOVISUAL MATERIALS

Download pdf | Full Screen View

Date Issued:
2020
Abstract/Description:
Engagement with educational instruction and related materials is an important part of learning and contributes to test performance. There are various measures of engagement including self-reports, observations, pupil diameter, and posture. With the challenges associated with obtaining accurate engagement levels, such as difficulties with measuring variations in engagement, the present study used a novel approach to predict engagement from posture by using deep learning. Deep learning was used to analyze a labeled outline of the participants and extract key points that are expected to predict engagement. In the first experiment two short lectures were presented and participants were tested on a lecture to motivate engagement. The next experiment had videos that varied in interest to understand whether a more interesting presentation engages participants more, therefore helping participants achieve higher comprehension scores. In a third experiment, one video was presented to attempt to use posture to predict comprehension rather than engagement. The fourth experiment had videos that varied in level of difficulty to determine whether a challenging topic versus an easier topic affects engagement. T-tests revealed that the more interesting Ted Talk was rated as more engaging, and for the fourth study, the more difficult video was rated as more engaging. Comparing average pupil sizes did not reveal significant differences that would relate to differences in the engagement scores, and average pupil dilation did not correlate with engagement. Analyzing posture through deep learning resulted in three accurate predictive models and a way to predict comprehension. Since engagement relates to learning, researchers and educators can benefit from accurate engagement measures.
Title: DEEP LEARNING OF POSTURAL AND OCULAR DYNAMICS TO PREDICT ENGAGEMENT AND LEARNING OF AUDIOVISUAL MATERIALS.
164 views
120 downloads
Name(s): Perez, Nicole, author
Barenholtz, Elan , Thesis advisor
Florida Atlantic University, Degree grantor
Department of Psychology
Charles E. Schmidt College of Science
Type of Resource: text
Genre: Electronic Thesis Or Dissertation
Date Created: 2020
Date Issued: 2020
Publisher: Florida Atlantic University
Place of Publication: Boca Raton, Fla.
Physical Form: online resource
Extent: 58 p.
Language(s): English
Abstract/Description: Engagement with educational instruction and related materials is an important part of learning and contributes to test performance. There are various measures of engagement including self-reports, observations, pupil diameter, and posture. With the challenges associated with obtaining accurate engagement levels, such as difficulties with measuring variations in engagement, the present study used a novel approach to predict engagement from posture by using deep learning. Deep learning was used to analyze a labeled outline of the participants and extract key points that are expected to predict engagement. In the first experiment two short lectures were presented and participants were tested on a lecture to motivate engagement. The next experiment had videos that varied in interest to understand whether a more interesting presentation engages participants more, therefore helping participants achieve higher comprehension scores. In a third experiment, one video was presented to attempt to use posture to predict comprehension rather than engagement. The fourth experiment had videos that varied in level of difficulty to determine whether a challenging topic versus an easier topic affects engagement. T-tests revealed that the more interesting Ted Talk was rated as more engaging, and for the fourth study, the more difficult video was rated as more engaging. Comparing average pupil sizes did not reveal significant differences that would relate to differences in the engagement scores, and average pupil dilation did not correlate with engagement. Analyzing posture through deep learning resulted in three accurate predictive models and a way to predict comprehension. Since engagement relates to learning, researchers and educators can benefit from accurate engagement measures.
Identifier: FA00013558 (IID)
Degree granted: Dissertation (Ph.D.)--Florida Atlantic University, 2020.
Collection: FAU Electronic Theses and Dissertations Collection
Note(s): Includes bibliography.
Subject(s): Instruction
Effective teaching
Pupil (Eye)
Posture
Deep learning
Engagement
Held by: Florida Atlantic University Libraries
Sublocation: Digital Library
Persistent Link to This Record: http://purl.flvc.org/fau/fd/FA00013558
Use and Reproduction: Copyright © is held by the author with permission granted to Florida Atlantic University to digitize, archive and distribute this item for non-profit research and educational purposes. Any reuse of this item in excess of fair use or other copyright exemptions requires permission of the copyright holder.
Use and Reproduction: http://rightsstatements.org/vocab/InC/1.0/
Host Institution: FAU
Is Part of Series: Florida Atlantic University Digital Library Collections.