Smart Hearing Multilingual Device with Gesture Detection

A significant issue that arises is the communication barriers suffered by individuals with speech and hearing impairments. The smart system includes sign language to voice and text to sign language conversion system which enables bidirectional for differently abled people. The proposed project includes the Raspberry Pi5 which acts as the processing unit connected to a camera for detecting hand gestures and speech input. The text will be detected and will be converted into the sign language. It utilizes the google translator API for multilingual support. It even converts the sign into speech with the help of Pygame. This allows to bridge the communication gap in the society.