2025/08/03 by Jeanelle Dao, Dao, Jeanelle, Jadelynn Dao +1
Computer Science · Neuroscience · #Audio and Speech Processing (eess.AS) #FOS: Electrical engineering #Hand Gesture Recognition Systems #Hearing Loss and Rehabilitation #Speech and Audio Processing #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2508.01576
openalex publication_date 2025/08/03 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
According to the World Health Organization, 430 million people experience disabling hearing loss. For them, recognizing spoken commands such as one's name is difficult. To address this issue, Lumename, a real-time smartwatch, utilizes on-device machine learning to detect a user-customized name before generating a haptic-visual alert. During training, to overcome the need for large datasets, Lumename uses novel audio modulation techniques to augment samples from one user and generate additional samples to represent diverse genders and ages. Constrained random iterations were used to find optimal parameters within the model architecture. This approach resulted in a low-resource and low-power TinyML model that could quickly infer various keyword samples while remaining 91.67% accurate on a custom-built smartwatch based on an Arduino Nano 33 BLE Sense.