Emotion classification using physiological data with machine learning: case studies on healthy people and Alzheimer’s disease patients with dementia

Author(s)
서정렬
Alternative Author(s)
Jungryul Seo
Advisor
손경아
Department
일반대학원 컴퓨터공학과
Publisher
The Graduate School, Ajou University
Publication Year
2021-02
Language
eng
Keyword
Alzheimer’s diseaseArtificial intelligenceBrainDementiaEEGEmotion classificationGSRMachine learningPhysiological dataSensor
Alternative Abstract
In recent years, studies, products, and services that used artificial intelligence and physiological sensor s have been published. One of the trends is classifying the user's context, such as their emotional state, using physiological data. One of the motivations for classifying emotion classification studies is that emotions influence human behaviors, decision making, health, learning efficiency. Many emotion classifications studies have been conducted; however, none of the studies classified boredom using electroencephalogram (EEG) and galvanic skin response (GSR) data. Furthermore, studies that targeted Alzheimer's disease (AD) patients with dementia for classifying their emotions did not exist. In this study, we did a literature review related to emotion classification based on physiological sensors and set healthy people (13 males and 15 females, mean age 23.62) and AD patients with dementia (30 females, mean age 83.9) as target groups. Then, we designed a data collection protocol for each target group and collected physiological data (healthy group: EEG and GSR, and AD patients with dementia group: EEG data) when exposed to video and image stimuli designed to evoke the target emotions. Using the data, I trained emotion classification models with conventional machine learning and deep learning algorithms. As a result, the model trained with multilayer perceptron (MLP) showed 79.98% mean accuracy from 1,000 iterations of five-fold cross-validation. For the model of AD patients with dementia, the ensemble model that consisted of MLP and convolution neural network showed 73.33% accuracy from leave-one-out cross-validation. Additionally, we analyzed the correlations between boredom state and collected data and indicated that healthy people's approach to classifying emotion is possible for AD patients with dementia. These results can be utilizing for affective computing systems and understanding correlations between emotional states and physiological responses.
URI
https://dspace.ajou.ac.kr/handle/2018.oak/20279
Fulltext

Appears in Collections:
Graduate School of Ajou University > Department of Computer Engineering > 4. Theses(Ph.D)
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse