AI-Powered Sign Language Translator Developed by AIML Students

Final-year students M. Manish, Nishanth, Nishanth A. Jatthan, and Surabhi Jogi from the Department of Artificial Intelligence and Machine Learning at Shri Madhwa Vadiraja Institute of Technology and Management (SMVITM), Bantakal, have developed VAANI-DRISHTI, an innovative Artificial Intelligence-based system designed to bridge communication gaps between Indian Sign Language (ISL) users and the hearing community.

The project was carried out under the guidance of Dr. Mamatha I and enables real-time bidirectional communication by translating Indian Sign Language gestures into speech and converting spoken language into ISL video outputs. The system employs Support Vector Machine (SVM)-based gesture recognition and Natural Language Processing (NLP) techniques to facilitate seamless interaction between users.

VAANI-DRISHTI integrates multiple technologies, including hand gesture recognition, speech processing, language modeling, and an intuitive user interface, to provide an efficient and user-friendly communication platform. By enabling effective interaction between individuals with hearing and speech impairments and the wider community, the system seeks to enhance accessibility and foster greater social inclusion.

The project demonstrates how Artificial Intelligence can be leveraged to address real-world societal challenges and create meaningful technological solutions. Through this innovative initiative, the students have showcased the potential of AI in empowering individuals with communication disabilities and promoting equal opportunities for all sections of society.

The development of VAANI-DRISHTI reflects the commitment of SMVITM students and faculty towards innovation, research, and the application of emerging technologies for social good.