Natural video synthesis with Generative Adversarial Networks

Abstract

Generative Adversarial Networks (GANs) are the state of the art neural network models for image generation, but the use of GANs for video generation is still largely unexplored. This thesis introduces new GAN based video generation methods by proposing the technique of model inflation and the segmentation-to-video task. The model inflation technique converts image generative models into video generative models, and experiments show that model inflation improves training speed, training stability, and output video quality. The segmentation-to-video task is that of turning an input image segmentation mask into an output video matching that segmentation. A GAN model was created to perform this task, and its usefulness as a creative tool was demonstrated.