2021/03/01 by Nahyun Kwon, Kwon, Nahyun, Yun-Jung Lee +3
Computer Science · Neuroscience · #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Tactile and Sensory Interactions #Virtual Reality Applications and Impacts #Visual Attention and Saliency Detection
paper · pdf · doi:10.48550/arxiv.2103.01347
openalex publication_date 2021/03/01 · openalex created_date 2022/07/25 · openalex updated_date 2026/07/28
While people with visual impairments are interested in artwork as much as\ntheir sighted peers, their experience is limited to few selective artworks that\nare exhibited at certain museums. To enable people with visual impairments to\naccess and appreciate as many artworks as possible at ease, we propose an\nonline art gallery that allows users to explore different parts of a painting\ndisplayed on their touchscreen-based devices while listening to corresponding\nverbal descriptions of the touched part on the screen. To investigate the\nscalability of our approach, we first explored if anonymous crowd who may not\nhave expertise in art are capable of providing visual descriptions of artwork\nas a preliminary study. Then we conducted a user study with 9 participants with\nvisual impairments to explore the potential of our system for independent\nartwork appreciation by assessing if and how well the system supports 4 steps\nof Feldman Model of Criticism. The findings suggest that visual descriptions of\nartworks produced by an anonymous crowd are sufficient for people with visual\nimpairments to interpret and appreciate paintings with their own judgments\nwhich is different from existing approaches that focused on delivering\ndescriptions and opinions written by art experts. Based on the lessons learned\nfrom the study, we plan to collect visual descriptions of a greater number of\nartwork and distribute our online art gallery publicly to make more paintings\naccessible for people with visual impairments.\n