2019/01/30 by Yang, Chih-Yuan, Yun, Heeseung, Varadaraj, Srenavis +1
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
paper · doi:10.48550/arxiv.1901.10713
We develop a system which generates summaries from seniors' indoor-activity videos captured by a social robot to help remote family members know their seniors' daily activities at home. Unlike the traditional video summarization datasets, indoor videos captured from a moving robot poses additional challenges, namely, (i) the video sequences are very long (ii) a significant number of video-frames contain no-subject or with subjects at ill-posed locations and scales (iii) most of the well-posed frames contain highly redundant information. To address this problem, we propose to \hlexploit pose estimation \hlfor detecting people in frames\hl. This guides the robot to follow the user and capture effective videos. We use person identification to distinguish a target senior from other people. We \hlalso make use of action recognition to analyze seniors' major activities at different moments, and develop a video summarization method to select diverse and representative keyframes as summaries.