Skip to main navigation Skip to search Skip to main content

Hybrid Deep Learning Algorithm for Real-Time Emotion Detection from Facial Expressions

  • R. V.S. Praveen
  • , Anurag Shrivastava
  • , Nidal Al Said
  • , Mohammed I. Habelalmateen
  • , Kanchan Yadav
  • , Ali S. Haleem
  • , Mostafa Abdulsalam Alhayaly
  • LTIMindtree
  • Saveetha Institute of Medical and Technical Sciences (Deemed to be University)
  • The Islamic University, Najaf
  • GLA University
  • Al-Mustaqbal University College
  • Bayan University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Effective and real-time facial expression detection is becoming increasingly crucial in affective computing, intelligent user interfaces, and mental health screening to comprehend human emotions. Lighting, face angle, and occlusion changes typically challenge standard emotion recognition algorithms in real-life, ever-changing scenarios. This paper introduces EmotionSenseNet, a novel Emotion Sensing Network with Spatiotemporal and Attention Fusion, a deep learning network that combines spatial, temporal, and attentional data, improving emotion identification and targeting these issues. The design uses a lightweight CNN based on MobileNetV2 to extract spatial information and an LSTM network to define facial motion temporal correlations. The approach is simplified with a focus module highlighting essential face traits and periods. Face landmark alignment preprocessing provides input normalization across face pictures. The suggested technique has minimal latency and 91.3% accuracy on benchmark datasets like FER-2013 and CK+, making it suited for real-time edge device applications. Despite practical constraints, EmotionSenseNet can identify emotions reliably and scalable. Therefore, future research will focus on establishing more extensive emotional classifications and energy-efficient embedded system deployment techniques.

Original languageEnglish
Title of host publicationICCR 2025 - 3rd International Conference on Cyber Resilience
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331555535
DOIs
StatePublished - 2025
Event3rd International Conference on Cyber Resilience, ICCR 2025 - Dubai, United Arab Emirates
Duration: 3 Jul 20254 Jul 2025

Publication series

NameICCR 2025 - 3rd International Conference on Cyber Resilience

Conference

Conference3rd International Conference on Cyber Resilience, ICCR 2025
Country/TerritoryUnited Arab Emirates
CityDubai
Period3/07/254/07/25

Keywords

  • EmotionSenseNet
  • Facial Emotion Recognition
  • Hybrid Deep Learning
  • Real-Time Emotion Detection
  • Spatiotemporal Feature Fusion

Fingerprint

Dive into the research topics of 'Hybrid Deep Learning Algorithm for Real-Time Emotion Detection from Facial Expressions'. Together they form a unique fingerprint.

Cite this