2017/05/15 by Takahisa Kishino, Zhe Sun, Kishino, Takahisa +6 · 1 citation
Biochemistry, Genetics and Molecular Biology · Neuroscience · Psychology · #FOS: Biological sciences #Hearing Loss and Rehabilitation #I.5 #I.5.1 #J.4 #Multisensory perception and integration #Neurons and Cognition (q-bio.NC) #Tactile and Sensory Interactions #q-bio.NC
paper · pdf · doi:10.48550/arxiv.1705.05074
arxiv created 2017/05/15 · openalex publication_date 2017/05/15 · arxiv updated 2017/05/16 · openalex created_date 2017/05/26 · openalex updated_date 2026/07/28
In this study we describe a methodology to realize visual images cognition in the broader sense, by a cross-modal stimulation through the auditory channel. An original algorithm of conversion from bi-dimensional images to sounds has been established and tested on several subjects. Our results show that subjects where able to discriminate with a precision of 95% different sounds corresponding to different test geometric shapes. Moreover, after brief learning sessions on simple images, subjects where able to recognize among a group of 16 complex and never-trained images a single target by hearing its acoustical counterpart. Rate of recognition was found to depend on image characteristics, in 90% of the cases, subjects did better than choosing at random. This study contribute to the understanding of cross-modal perception and help for the realization of systems that use acoustical signals to help visually impaired persons to recognize objects and improve navigation