By Bianchi Gabriele on March 1, 2022
The project was born with the purpose of helping the deaf community to communicate and interact easily with the surrounding environment. The goal is to convert the basic symbols representing the 26 letters of English alphabet and display them on a smartphone screen.
For this system we were inspired by the idea of controlling a robotic arm with hand movements. The accelerometer is used here to measure the inclination of the palm and five flex sensors are positioned on a glove at the 5 fingers. These sensors measure the crease of the fingers and palm and based on the value of the set of angles the Arduino Nano microcontroller understands which symbol has been represented and transfers the result to the Android app via Bluetooth (HC-05 module).