vix.ing · top · new · best · stats

Xp-GAN: Unsupervised Multi-object Controllable Video Generation

2021/11/19 by Bahman Rouhani, Rouhani, Bahman, Mohammad Rahmati +1
Computer Science · Engineering · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Human Pose and Action Recognition #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #cs.CV #cs.LG #eess.IV #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2111.10233

8 pages, 9 figures

arxiv created 2021/11/19 · openalex publication_date 2021/11/19 · arxiv updated 2021/11/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Video Generation is a relatively new and yet popular subject in machine learning due to its vast variety of potential applications and its numerous challenges. Current methods in Video Generation provide the user with little or no control over the exact specification of how the objects in the generate video are to be moved and located at each frame, that is, the user can't explicitly control how each object in the video should move. In this paper we propose a novel method that allows the user to move any number of objects of a single initial frame just by drawing bounding boxes over those objects and then moving those boxes in the desired path. Our model utilizes two Autoencoders to fully decompose the motion and content information in a video and achieves results comparable to well-known baseline and state of the art methods.

Citations

Related