Skip to main navigation Skip to search Skip to main content

Contactless Body Gesture Recognition for Enhancing Non-Verbal Communication: A Deep Learning Approach Using RF Sensing

  • Aisha Fatima
  • , Hira Hameed
  • , Balal Saleemi
  • , Muhammad Ali Imran
  • , Qammer H. Abbasi
  • , Hasan Abbas
  • University of Glasgow

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Deaf-mute individuals communicate through sign language, which involves hands and hand movements, body postures, and facial expressions. Despite advancements, recognizing sign language through automation continues to be a complex and emerging field of research. Current methods typically rely on sensor-based and vision-based approaches, both of which have limitations, such as privacy concerns, maintenance requirements, and sensitivity to ambient lighting conditions. Consequently, contactless sensing has emerged as a promising solution for recognizing automatic sign language. This study proposed a framework that used contactless sensing to recog-nise five specific gestures-Sad, Neutral, Fearful, Happy, and Surprised. A dataset of 150 samples is collected (each class is repeated 30 times). Afterthat, three pre-trained deep learning models: MobileNet, ResNet50, and VGGI6 are employed for the classification purpose. ResNet50 outperformed other models with 96% accuracy.

Original languageEnglish
Title of host publication2025 2nd International Conference on Microwave, Antennas and Circuits, ICMAC 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331518424
DOIs
StatePublished - 2025
Externally publishedYes
Event2nd International Conference on Microwave, Antennas and Circuits, ICMAC 2025 - Islamabad, Pakistan
Duration: 17 Apr 202518 Apr 2025

Publication series

Name2025 2nd International Conference on Microwave, Antennas and Circuits, ICMAC 2025

Conference

Conference2nd International Conference on Microwave, Antennas and Circuits, ICMAC 2025
Country/TerritoryPakistan
CityIslamabad
Period17/04/2518/04/25

Keywords

  • Body Gestures
  • Contactless Sensing
  • Deep Learning
  • Sign Language
  • Xethru X4M03 Radar

Fingerprint

Dive into the research topics of 'Contactless Body Gesture Recognition for Enhancing Non-Verbal Communication: A Deep Learning Approach Using RF Sensing'. Together they form a unique fingerprint.

Cite this