View All Items

Title: An Augmentative System with Facial and Emotion Recognition for Improving the Skills of Children with Autism Spectrum Disorders.
Creator: Alharbi, Mohammed N., Huang, Shihong, Florida Atlantic University, College of Engineering and Computer Science, Department of Computer and Electrical Engineering and Computer Science
Abstract/Description: Autism spectrum disorders (ASDs) are one of the complex, pervasive, and multifactorial neurodevelopmental conditions which affect one in 68 children. Scientific research has proven the efficiency of using technologies to improve communication and social skills of autistic children. The use of technological devices, such as mobile applications and multimedia, increase the interest of autistic children to learn while playing games. This thesis presents the re-engineering, extension, and...
Show moreAutism spectrum disorders (ASDs) are one of the complex, pervasive, and multifactorial neurodevelopmental conditions which affect one in 68 children. Scientific research has proven the efficiency of using technologies to improve communication and social skills of autistic children. The use of technological devices, such as mobile applications and multimedia, increase the interest of autistic children to learn while playing games. This thesis presents the re-engineering, extension, and evolution of an existing prototype Windows-based mobile application called Ying to become an Android mobile application which is augmented with facial and emotion recognition. This mobile app complements different approaches of traditional therapy, such as Applied Behavior Analysis (ABA). Ying integrates different computer-assisted technologies, including speech recognition, audio and visual interaction, and mobile applications to enhance autistic children’s social behavior and verbal communication skills. An evaluation of the efficacy of using Ying has been conducted and its results are presented in the thesis.
Show less
Date Issued: 2018
PURL: http://purl.flvc.org/fau/fd/FA00005981
Subject Headings: Autism spectrum disorders, Human-computer interaction, Mobile apps
Format: Document (PDF)

Title: INCORPORATING EMOTION RECOGNITION IN CO-ADAPTIVE SYSTEMS.
Creator: Al-Omair, Osamah M., Huang, Shihong, Florida Atlantic University, Department of Computer and Electrical Engineering and Computer Science, College of Engineering and Computer Science
Abstract/Description: The collaboration between human and computer systems has grown astronomically over the past few years. The ability of software systems adapting to human's input is critical in the symbiosis of human-system co-adaptation, where human and software-based systems work together in a close partnership to achieve synergetic goals. However, it is not always clear what kinds of human’s input should be considered to enhance the effectiveness of human and system co-adaptation. To address this issue,...
Show moreThe collaboration between human and computer systems has grown astronomically over the past few years. The ability of software systems adapting to human's input is critical in the symbiosis of human-system co-adaptation, where human and software-based systems work together in a close partnership to achieve synergetic goals. However, it is not always clear what kinds of human’s input should be considered to enhance the effectiveness of human and system co-adaptation. To address this issue, this research describes an approach that focuses on incorporating human emotion to improve human-computer co-adaption. The key idea is to provide a formal framework that incorporates human emotions as a foundation for explainability into co-adaptive systems, especially, how software systems recognize human emotions and adapt the system’s behaviors accordingly. Detecting and recognizing optimum human emotion is a first step towards human and computer symbiosis. As the first step of this research, we conduct a comparative review for a number of technologies and methods for emotion recognition. Specifically, testing the detection accuracy of facial expression recognition of different cloud-services, algorithms, and methods. Secondly, we study the application of emotion recognition within the areas of e-learning, robotics, and explainable artificial intelligence (XAI). We propose a formal framework that incorporates human emotions into an adaptive e-learning system, to create a more personalized learning experience for higher quality of learning outcomes. In addition, we propose a framework for a co-adaptive Emotional Support Robot. This human-centric framework adopts a reinforced learning approach where the system assesses its own emotional re-actions.
Show less
Date Issued: 2022
PURL: http://purl.flvc.org/fau/fd/FA00013926
Subject Headings: Emotion recognition, Human-computer interaction, Affective Computing
Format: Document (PDF)

Title: Cognitive styles and concept mapping dimensions of hypermedia computer users.
Creator: Kessler, Rohn., Florida Atlantic University, Morris, John D., Hunt, John J.
Abstract/Description: Computers are increasingly a part of college and university instruction. Interactive hypermedia applications are being introduced throughout much of the curriculum as a possible solution to both improving educational outcomes and expanding educational horizons. The purpose of the present study was to investigate the effects of an interactive hypermedia application and a section of text on a measure of learning and understanding called concept mapping. The inter-rater reliability of concept...
Show moreComputers are increasingly a part of college and university instruction. Interactive hypermedia applications are being introduced throughout much of the curriculum as a possible solution to both improving educational outcomes and expanding educational horizons. The purpose of the present study was to investigate the effects of an interactive hypermedia application and a section of text on a measure of learning and understanding called concept mapping. The inter-rater reliability of concept map scores has not been reported previously in the literature. Results in this study concerning the reliability of concept map scoring procedures indicated that the continued improvement of inter-rater reliability is desirable if concept mapping is to actualize its potential as a practical, useful, and unique learning tool. Results suggest that concept mapping appears capable of assessing: (a) baseline knowledge, (b) meaningful learning, (c) the construction of new knowledge, and (d) knowledge change. Its usefulness in these areas and as an alternative or addition to standardized assessment is contingent, however, upon demonstrations of validity and reliability. Suggestions for further concept map research included: (a) replicating the present study with other measures of cognitive style across a wide variety of interactive hypermedia software applications, (b) doing longitudinal studies of concept mapping, (c) improving the reliablity of concept map scoring and evaluation, (d) looking at other aspects of cognition and information processing related to concept mapping, (e) using computer-based concept mapping tools, and (f) using concept maps as templates for the organization and integration of hypermedia elements.
Show less
Date Issued: 1995
PURL: http://purl.flvc.org/fcla/dt/12404
Subject Headings: Hypertext systems, Interactive multimedia, Concept learning, Computer-assisted instruction, Curriculum planning, Human-computer interaction
Format: Document (PDF)

Title: Exploiting audiovisual attention for visual coding.
Creator: Torres, Freddy., College of Engineering and Computer Science, Department of Computer and Electrical Engineering and Computer Science
Abstract/Description: Perceptual video coding has been a promising area during the last years. Increases in compression ratios have been reported by applying foveated video coding techniques where the region of interest (ROI) is selected by using a computational attention model. However, most of the approaches for perceptual video coding only use visual features ignoring the auditory component. In recent physiological studies, it has been demonstrated that auditory stimuli affects our visual perception. In this...
Show morePerceptual video coding has been a promising area during the last years. Increases in compression ratios have been reported by applying foveated video coding techniques where the region of interest (ROI) is selected by using a computational attention model. However, most of the approaches for perceptual video coding only use visual features ignoring the auditory component. In recent physiological studies, it has been demonstrated that auditory stimuli affects our visual perception. In this work, we validate some of those physiological tests using complex video sequence. We designed and developed a web-based tool for video quality measurement. After conducting different experiments, we observed that in the general reaction time to detect video artifacts was higher when video was presented with the audio information. We observed that emotional information in audio guide human attention to particular ROI. We also observed that sound frequency change spatial frequency perception in still images.
Show less
Date Issued: 2013
PURL: http://purl.flvc.org/fcla/dt/3361251
Subject Headings: Digital video, Image processing, Digital techniques, Visual perception, Coding theory, Human-computer interaction, Intersensory effects
Format: Document (PDF)

Title: Let’s Get Real: Shifting Perspectives of Virtual Life.
Creator: Millar, Cailley, Mason, Julia, Florida Atlantic University, Dorothy F. Schmidt College of Arts and Letters, Department of English
Abstract/Description: A hallmark of the cyberpunk era, virtual reality is now a real and readily available medium for technological entertainment and lifestyle. Cyberpunk texts and contemporary SF that incorporates virtual reality provide a framework for considering the implications of this newly popularized technology. By allowing the user to explore new forms of identity in an alternate reality, virtual reality poses many interesting opportunities for undermining current social constructs related to gender, race...
Show moreA hallmark of the cyberpunk era, virtual reality is now a real and readily available medium for technological entertainment and lifestyle. Cyberpunk texts and contemporary SF that incorporates virtual reality provide a framework for considering the implications of this newly popularized technology. By allowing the user to explore new forms of identity in an alternate reality, virtual reality poses many interesting opportunities for undermining current social constructs related to gender, race, and identity. This thesis investigates real and fictional examples of virtual reality and the significance of authorship and narrative construction, race and social hierarchies, death and selfpermanence, and gender performance across the boundary between virtual and material space.
Show less
Date Issued: 2017
PURL: http://purl.flvc.org/fau/fd/FA00004817, http://purl.flvc.org/fau/fd/FA00004817
Subject Headings: Cybernetics., Cyberpunk culture., Virtual reality., Human-computer interaction., Computer simulation., Knowledge, Sociology of.
Format: Document (PDF)

Title: Image detection for a customizable user interface.
Creator: Polimeni, Joseph C., Florida Atlantic University, Mahgoub, Imad, College of Engineering and Computer Science, Department of Computer and Electrical Engineering and Computer Science
Abstract/Description: A user interface that has objects familiar to the user will be easier to use. In this thesis, a user interface that is customizable to any color bitmap is proposed. The most significant problem with this approach is the problem of finding objects in a color bitmap. A solution to the problem is proposed and evaluated using an analysis tool, developed for this thesis, called Workbench. Current image detection methods are evaluated and compared to the solution proposed using Workbench. The...
Show moreA user interface that has objects familiar to the user will be easier to use. In this thesis, a user interface that is customizable to any color bitmap is proposed. The most significant problem with this approach is the problem of finding objects in a color bitmap. A solution to the problem is proposed and evaluated using an analysis tool, developed for this thesis, called Workbench. Current image detection methods are evaluated and compared to the solution proposed using Workbench. The proposed solution is then evaluated for the YIQ and HSI color mappings. The results of this investigation and recommendations for future work is proposed.
Show less
Date Issued: 1995
PURL: http://purl.flvc.org/fcla/dt/15207
Subject Headings: User interfaces (Computer systems), Human-computer interaction, Image processing--Digital techniques
Format: Document (PDF)

Title: A PROBABILISTIC CHECKING MODEL FOR EFFECTIVE EXPLAINABILITY BASED ON PERSONALITY TRAITS.
Creator: Alharbi, Mohammed N., Huang, Shihong, Florida Atlantic University, Department of Computer and Electrical Engineering and Computer Science, College of Engineering and Computer Science
Abstract/Description: It is becoming increasingly important for an autonomous system to be able to explain its actions to humans in order to improve trust and enhance human-machine collaboration. However, providing the most appropriate kind of explanations – in terms of length, format, and presentation mode of explanations at the proper time – is critical to enhancing their effectiveness. Explanation entails costs, such as the time it takes to explain and for humans to comprehend and respond. Therefore, the actual...
Show moreIt is becoming increasingly important for an autonomous system to be able to explain its actions to humans in order to improve trust and enhance human-machine collaboration. However, providing the most appropriate kind of explanations – in terms of length, format, and presentation mode of explanations at the proper time – is critical to enhancing their effectiveness. Explanation entails costs, such as the time it takes to explain and for humans to comprehend and respond. Therefore, the actual improvement in human-system tasks from explanations (if any) is not always obvious, particularly given various forms of uncertainty in knowledge about humans. In this research, we propose an approach to address this issue. The key idea is to provide a structured framework that allows a system to model and reason about human personality traits as critical elements to guide proper explanation in human and system collaboration. In particular, we focus on the two concerns of modality and amount of explanation in order to optimize the explanation experience and improve overall system-human utility. Our models are based on probabilistic modeling and analysis (PRISM-games) to determine at run time what the most effective explanation under uncertainty is. To demonstrate our approach, we introduce a self-adaptative system called Grid – a virtual game – and the Stock Prediction Engine (SPE), which allows an automated system and a human to collaborate on the game and stock investments. Our evaluation of these exemplars, through simulation, demonstrates that a human subject’s performance and overall human-system utility is improved when considering the psychology of human personality traits in providing explanations.
Show less
Date Issued: 2022
PURL: http://purl.flvc.org/fau/fd/FA00013894
Subject Headings: Human-computer interaction, Probabilistic modelling, Human-machine systems, Affective Computing
Format: Document (PDF)

Title: Augmented reality methods and algorithms for hearing augmentation.
Creator: Carmigniani, Julie., Charles E. Schmidt College of Science, Department of Computer and Electrical Engineering and Computer Science
Abstract/Description: While new technologies are often used to facilitate regular people's lives, they often fail to see their potential in helping disabled people. Augmented reality, one of the newest state-of-the-art technologies, offers users the opportunity to add virtual information to their real world surroundings in real time. It also has the potential to not only augment the sense of sight, but also other senses such as hearing. Augmented reality could be used to offer the opportunity to complement users'...
Show moreWhile new technologies are often used to facilitate regular people's lives, they often fail to see their potential in helping disabled people. Augmented reality, one of the newest state-of-the-art technologies, offers users the opportunity to add virtual information to their real world surroundings in real time. It also has the potential to not only augment the sense of sight, but also other senses such as hearing. Augmented reality could be used to offer the opportunity to complement users' missing sense. In this thesis, we study augmented reality technologies, systems and applications, and suggest the future of AR applications. We explain how to integrate augmented reality into iOS applications and propose an augmented reality application for hearing augmentation using an iPad2. We believe mobile devices are the best platform for augmented reality as they are widespread and their computational power is rapidly growing to be able to handle true AR applications.
Show less
Date Issued: 2011
PURL: http://purl.flvc.org/FAU/3332178
Subject Headings: Mobile communication systems, Augmented reality, Computer graphics, Virtual reality, Human-computer interaction, User interfaces (Computer systems), Application software, Development
Format: Document (PDF)

Title: The Effects of Preattention in an Online Advertising Context: A Neuroscience Perspective.
Creator: Milosavljevic, Milica, Shaw, Eric H., Florida Atlantic University
Abstract/Description: Consumers are exposed to thousands of marketing messages every day. In such a cluttered environment, gaining consumers· attention becomes an increasingly important business objective. This study expands the concept of attention from a simple view of attention as se lection of stimuli to a more elaborate two step process consisting of (I) preattention and (2) focal attention. The focus of this research is on preattention, which is determined by physical characteristics of objects in a visual...
Show moreConsumers are exposed to thousands of marketing messages every day. In such a cluttered environment, gaining consumers· attention becomes an increasingly important business objective. This study expands the concept of attention from a simple view of attention as se lection of stimuli to a more elaborate two step process consisting of (I) preattention and (2) focal attention. The focus of this research is on preattention, which is determined by physical characteristics of objects in a visual scene. This study also i1Pproves the measurement ofpreattention by surveying the neuroscience literature and using a computational model to measure preattention. This improved measure allows us to provide an enhanced explanation of how preattention f::tcilitates mere exposure effects. Results confirm that preattentive processing of an ad in a visual scene affects liking of that ad even when people do not remember previously seeing the advertisement. The study also finds that subtle. preattentive processes require increasing amounts of time in order to affect focal attention and attitude toward the ad.
Show less
Date Issued: 2007
PURL: http://purl.flvc.org/fau/fd/FA00000607
Subject Headings: Internet Advertising--Psychological Aspects, Marketing--Psychological Aspects, Advertising--Effective Frequency, Human-Computer Interaction
Format: Document (PDF)

Title: Determining the Effectiveness of Human Interaction in Human-in-the-Loop Systems by Using Mental States.
Creator: Lloyd, Eric, Huang, Shihong, Florida Atlantic University, College of Engineering and Computer Science, Department of Computer and Electrical Engineering and Computer Science
Abstract/Description: A self-adaptive software is developed to predict the stock market. It’s Stock Prediction Engine functions autonomously when its skill-set suffices to achieve its goal, and it includes human-in-the-loop when it recognizes conditions benefiting from more complex, expert human intervention. Key to the system is a module that decides of human participation. It works by monitoring three mental states unobtrusively and in real time with Electroencephalography (EEG). The mental states are drawn from...
Show moreA self-adaptive software is developed to predict the stock market. It’s Stock Prediction Engine functions autonomously when its skill-set suffices to achieve its goal, and it includes human-in-the-loop when it recognizes conditions benefiting from more complex, expert human intervention. Key to the system is a module that decides of human participation. It works by monitoring three mental states unobtrusively and in real time with Electroencephalography (EEG). The mental states are drawn from the Opportunity-Willingness-Capability (OWC) model. This research demonstrates that the three mental states are predictive of whether the Human Computer Interaction System functions better autonomously (human with low scores on opportunity and/or willingness, capability) or with the human-in-the-loop, with willingness carrying the largest predictive power. This transdisciplinary software engineering research exemplifies the next step of self-adaptive systems in which human and computer benefit from optimized autonomous and cooperative interactions, and in which neural inputs allow for unobtrusive pre-interactions.
Show less
Date Issued: 2016
PURL: http://purl.flvc.org/fau/fd/FA00004764, http://purl.flvc.org/fau/fd/FA00004764
Subject Headings: Cognitive neuroscience., Neural networks (Computer science), Pattern recognition systems., Artificial intelligence., Self-organizing systems., Human-computer interaction., Human information processing.
Format: Document (PDF)

Title: Enhancing Independent Task Performance of Individuals with Developmental Disabilities Through the Use of an iPad Application.
Creator: Morse, Kerri, Dukes, Charles, Florida Atlantic University, College of Education, Department of Exceptional Student Education
Abstract/Description: There has been a dramatic increase in the utilization of technology within the fields of education and rehabilitation in the past two decades. Two studies focused on technology intended to assist a total of seven young adults with developmental disabilities to increase independence, decrease the need for paid supports, and improve task performance. Participants completed food preparation tasks in an employee break room, adhering to an industry specific protocol, while using a task application...
Show moreThere has been a dramatic increase in the utilization of technology within the fields of education and rehabilitation in the past two decades. Two studies focused on technology intended to assist a total of seven young adults with developmental disabilities to increase independence, decrease the need for paid supports, and improve task performance. Participants completed food preparation tasks in an employee break room, adhering to an industry specific protocol, while using a task application on an iPad that provided audio and video prompts. A multiple baseline across participants was used to show effects of the intervention on task performance and reliance on prompts. Results indicated that using an application on an iPad to video model tasks was effective in improving and maintaining accurate skill performance, while reducing the need for prompts. Participants in both study one and study two demonstrated mastery of task performance using the iPad application. In study one, three of the four participants faded the use of prompts, whereas only one of the three participants demonstrated independence in study two. Implications for future research are discussed.
Show less
Date Issued: 2016
PURL: http://purl.flvc.org/fau/fd/FA00004615, http://purl.flvc.org/fau/fd/FA00004615
Subject Headings: Students with disabilities--Services for., Learning disabled teenagers.--Education., Tablet computers., Computer-assisted instruction., Human-computer interaction., Education--Effect of technological innovations on., Visual programming (Computer science)
Format: Document (PDF)

Title: Social Interaction on Facebook.
Creator: Hanrahan, Jeffrey, Maniaci, Michael, Florida Atlantic University, Charles E. Schmidt College of Science, Department of Psychology
Abstract/Description: How we share our good news with people can have a significant effect on our lives. Sharing good news on social media sites involves a process called capitalization. Capitalization has been shown to increase well-being when others provide appropriate responses in face-to-face interactions. To see if this effect on well-being extends to our online presence, this study utilized the social media site Facebook to observe if capitalization predicted well-being and relationship satisfaction. This...
Show moreHow we share our good news with people can have a significant effect on our lives. Sharing good news on social media sites involves a process called capitalization. Capitalization has been shown to increase well-being when others provide appropriate responses in face-to-face interactions. To see if this effect on well-being extends to our online presence, this study utilized the social media site Facebook to observe if capitalization predicted well-being and relationship satisfaction. This study used data collected from 137 participants recruited from an undergraduate participant pool and from Amazon Mechanical Turk. Consistent with hypotheses, participants who reported receiving active and constructive responses after sharing a positive event on Facebook also reported greater personal well-being and relationship satisfaction. Although future experimental research is needed to establish causality, the current results suggest that the ways in which friends respond to social media posts are associated with personal and relationship well-being.
Show less
Date Issued: 2016
PURL: http://purl.flvc.org/fau/fd/FA00004602, http://purl.flvc.org/fau/fd/FA00004602
Subject Headings: Social media., Online social networks., Social networks--Psychological aspects., Social networks--Health aspects., Mobile communication systems--Social aspects., Human-computer interaction--Psychological aspects., Information society., Interpersonal communication--Psychological aspects.
Format: Document (PDF)

Human-computer interaction (7)	+ -
Human-computer interaction. (3)	+ -
Affective Computing (2)	+ -
User interfaces (Computer systems) (2)	+ -
Advertising--Effective Frequency (1)	+ -

Application software (1)	+ -
Artificial intelligence. (1)	+ -
Augmented reality (1)	+ -
Autism spectrum disorders (1)	+ -
Coding theory (1)	+ -
Cognitive neuroscience. (1)	+ -
Computer graphics (1)	+ -
Computer simulation. (1)	+ -
Computer-assisted instruction (1)	+ -
Computer-assisted instruction. (1)	+ -
Concept learning (1)	+ -
Curriculum planning (1)	+ -
Cybernetics. (1)	+ -
Cyberpunk culture. (1)	+ -
Development (1)	+ -
Digital techniques (1)	+ -
Digital video (1)	+ -
Education--Effect of technological innovations on. (1)	+ -
Emotion recognition (1)	+ -
Human information processing. (1)	+ -
Human-Computer Interaction (1)	+ -
Human-computer interaction--Psychological aspects. (1)	+ -
Human-machine systems (1)	+ -
Hypertext systems (1)	+ -
Image processing (1)	+ -

Florida Atlantic University (10)	+ -
Department of Computer and Electrical Engineering and Computer Science (7)	+ -
College of Engineering and Computer Science (6)	+ -
Huang, Shihong (4)	+ -
Alharbi, Mohammed N. (2)	+ -

Charles E. Schmidt College of Science (2)	+ -
Al-Omair, Osamah M. (1)	+ -
Carmigniani, Julie. (1)	+ -
College of Education (1)	+ -
Department of English (1)	+ -
Department of Exceptional Student Education (1)	+ -
Department of Psychology (1)	+ -
Dorothy F. Schmidt College of Arts and Letters (1)	+ -
Dukes, Charles (1)	+ -
Hanrahan, Jeffrey (1)	+ -
Hunt, John J. (1)	+ -
Kessler, Rohn. (1)	+ -
Lloyd, Eric (1)	+ -
Mahgoub, Imad (1)	+ -
Maniaci, Michael (1)	+ -
Mason, Julia (1)	+ -
Millar, Cailley (1)	+ -
Milosavljevic, Milica (1)	+ -
Morris, John D. (1)	+ -
Morse, Kerri (1)	+ -
Polimeni, Joseph C. (1)	+ -
Shaw, Eric H. (1)	+ -
Torres, Freddy. (1)	+ -

Search In

Sort Results By:

Narrow results by:

Collection

Topical Subject

Genre

Type of Resource

Language

Creator

Format

Owner