Publications
Design and Implementation of a Wearable Sound Recognition System with Real-Time Data Transmission and Motion Feedback
Feb 17, 2026Journal Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications (JoWUA)
Issue 16
Volume 4
This paper explains how an advanced wearable system was created that allows hands-free use by receiving sound information in real time and responding to movements. It uses both flex sensors and force-sensitive resistors to pick up all the details of hand gestures, along with a three-axis accelerometer that measures how the hand is moving. The sensors talk to ESP32 microcontrollers through ESP-NOW, so there is fast, secure and energy-saving data exchange without having to connect to Wi-Fi. Analogue inputs from the sensors are checked by the system, and any events that reach the set threshold cause the DFPlayer Mini to play immediate audio. It enables users to interact intuitively and contactless, which is useful for assistive devices for people with hearing issues, gesture controls and wearable human-computer interfaces. Problems to overcome are managing the noise in sensor data, synchronising the data from various sensors and guaranteeing timely and correct feedback when the environment is dynamic. Trials reveal that the system measures consistently, detects movements and changes in pressure accurately and sends wireless data with low delay. Because of its design, it is convenient for daily needs since it is lightweight, fits well and lasts for a longer time on a charge. The inclusion of motion feedback lets users feel and hear the proper responses to gestures and sounds they recognise. This study achieves this by providing a framework that handles large data, is easy to use and addresses the weaknesses in previous wearable technologies through precise sensing, real-time communication and quick responses. With its modular structure, the system can adopt beneficial future changes, including advanced algorithms for picking out sound signals and wider uses, an essential step for smart and interactive wearable devices.