AI-Powered Deaf Companion System for Inclusive Communication Between Deaf and Hearing Individuals

Abstract

The AI-Powered Deaf Companion System is designed to bridge the communication gap between deaf and hearing individuals using cutting-edge deep learning technologies. Leveraging Temporal Convolutional Networks (TCNs), the Sign Recognition Module (SRM) accurately interprets sign language gestures in real time. Meanwhile, the Speech Recognition and Synthesis Module (SRSM), powered by Hidden Markov Models (HMMs), converts spoken language into text, ensuring seamless bidirectional communication. To enhance accessibility, the Avatar Module (AM) visually translates spoken text into sign language gestures, making interactions more intuitive. By integrating computer vision, natural language processing (NLP), and speech synthesis, this system fosters inclusive communication, empowering the deaf community with greater independence and interaction opportunities.