vix.ing · top · new · best · stats · spec

Style-ERD: Responsive and Coherent Online Motion Style Transfer

2022/03/04 by Tianxin Tao, Xiaohang Zhan, Tao, Tianxin +5 · 1 citation
Engineering · Computer Science · #Human Motion and Animation #Advanced Vision and Imaging #Generative Adversarial Networks and Image Synthesis

paper · pdf · doi:10.48550/arxiv.2203.02574

Abstract

Motion style transfer is a common method for enriching character animation. Motion style transfer algorithms are often designed for offline settings where motions are processed in segments. However, for online animation applications, such as realtime avatar animation from motion capture, motions need to be processed as a stream with minimal latency. In this work, we realize a flexible, high-quality motion style transfer method for this setting. We propose a novel style transfer model, Style-ERD, to stylize motions in an online manner with an Encoder-Recurrent-Decoder structure, along with a novel discriminator that combines feature attention and temporal attention. Our method stylizes motions into multiple target styles with a unified model. Although our method targets online settings, it outperforms previous offline methods in motion realism and style expressiveness and provides significant gains in runtime efficiency

Cited by

Related