Emotion Detection from Facial Expression in Online Learning Through Using Synthetic Image Generation

Md Rayhan Kabir, M. Ali Akber Dewan, Fuhua Lin

Research output: Chapter in Book/Report/Conference proceedingPublished Conference contributionpeer-review

Abstract

Understanding students’ educational emotion is important for learning process, however, it is challenging to detect in an online learning environment. Deep learning architectures show excellent performance for emotion detection from facial expressions; however, their complexity and computational requirements limit their deployment on students’ edge devices. Additionally, the availability and the size of the datasets for detecting educational emotions are scarce. In this study, we propose a lightweight deep learning model based on MobileNet architecture which is deployable in students’ edge devices for educational emotion detection. We also propose a generative adversarial network based synthetic image generation technique to address the challenges of scarcity of the dataset. This framework is compared with the state-of-the-art models, where it demonstrated competitive performance while making it suitable for the edge devices for the educational emotion detection, and additionally, the use of the synthetic dataset further contributes to improve the performance of the proposed model.

Original languageEnglish
Title of host publicationArtificial Intelligence in HCI - 5th International Conference, AI-HCI 2024, Held as Part of the 26th HCI International Conference, HCII 2024, Proceedings
EditorsHelmut Degen, Stavroula Ntoa
Pages202-216
Number of pages15
DOIs
Publication statusPublished - 2024
Event5th International Conference on Artificial Intelligence in HCI, AI-HCI 2024, held as part of the 26th HCI International Conference, HCII 2024 - Washington, United States
Duration: 29 Jun. 20244 Jul. 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14735 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th International Conference on Artificial Intelligence in HCI, AI-HCI 2024, held as part of the 26th HCI International Conference, HCII 2024
Country/TerritoryUnited States
CityWashington
Period29/06/244/07/24

Keywords

  • Educational emotion detection
  • facial expression recognition
  • lightweight architecture
  • neural network
  • online learning

Fingerprint

Dive into the research topics of 'Emotion Detection from Facial Expression in Online Learning Through Using Synthetic Image Generation'. Together they form a unique fingerprint.

Cite this