You are here

FAU Collections » FAU Research Repository » FAU Theses and Dissertations

Exploiting audiovisual attention for visual coding

Download pdf | Full Screen View

Date Issued:
2013
Summary:
Perceptual video coding has been a promising area during the last years. Increases in compression ratios have been reported by applying foveated video coding techniques where the region of interest (ROI) is selected by using a computational attention model. However, most of the approaches for perceptual video coding only use visual features ignoring the auditory component. In recent physiological studies, it has been demonstrated that auditory stimuli affects our visual perception. In this work, we validate some of those physiological tests using complex video sequence. We designed and developed a web-based tool for video quality measurement. After conducting different experiments, we observed that in the general reaction time to detect video artifacts was higher when video was presented with the audio information. We observed that emotional information in audio guide human attention to particular ROI. We also observed that sound frequency change spatial frequency perception in still images.
Title: Exploiting audiovisual attention for visual coding.
102 views
20 downloads
Name(s): Torres, Freddy.
College of Engineering and Computer Science
Department of Computer and Electrical Engineering and Computer Science
Type of Resource: text
Genre: Electronic Thesis Or Dissertation
Date Issued: 2013
Publisher: Florida Atlantic University
Physical Form: electronic
Extent: x, 74 p. : ill. (some col.)
Language(s): English
Summary: Perceptual video coding has been a promising area during the last years. Increases in compression ratios have been reported by applying foveated video coding techniques where the region of interest (ROI) is selected by using a computational attention model. However, most of the approaches for perceptual video coding only use visual features ignoring the auditory component. In recent physiological studies, it has been demonstrated that auditory stimuli affects our visual perception. In this work, we validate some of those physiological tests using complex video sequence. We designed and developed a web-based tool for video quality measurement. After conducting different experiments, we observed that in the general reaction time to detect video artifacts was higher when video was presented with the audio information. We observed that emotional information in audio guide human attention to particular ROI. We also observed that sound frequency change spatial frequency perception in still images.
Identifier: 852863485 (oclc), 3361251 (digitool), FADT3361251 (IID), fau:4145 (fedora)
Note(s): by Freddy Torres.
Thesis (M.S.C.S.)--Florida Atlantic University, 2013.
Includes bibliography.
Mode of access: World Wide Web.
System requirements: Adobe Reader.
Subject(s): Digital video
Image processing -- Digital techniques
Visual perception
Coding theory
Human-computer interaction
Intersensory effects
Persistent Link to This Record: http://purl.flvc.org/fcla/dt/3361251
Use and Reproduction: http://rightsstatements.org/vocab/InC/1.0/
Host Institution: FAU