The GAN That Warped: Semantic Attribute Editing With Unpaired Data
- 1 June 2020
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5355-5364
- https://doi.org/10.1109/cvpr42600.2020.00540
Abstract
Deep neural networks have recently been used to edit images with great success, in particular for faces. However, they are often limited to only being able to work at a restricted range of resolutions. Many methods are so flexible that face edits can often result in an unwanted loss of identity. This work proposes to learn how to perform semantic image edits through the application of smooth warp fields. Previous approaches that attempted to use warping for semantic edits required paired data, i.e. example images of the same subject with different semantic attributes. In contrast, we employ recent advances in Generative Adversarial Networks that allow our model to be trained with unpaired data. We demonstrate face editing at very high resolutions (4k images) with a single forward pass of a deep network at a lower resolution. We also show that our edits are substantially better at preserving the subject's identity. The robustness of our approach is demonstrated by showing plausible image editing results on the Cub200 birds dataset. To our knowledge this has not been previously accomplished, due the challenging nature of the dataset.Keywords
This publication has 23 references indexed in Scilit:
- Bilateral guided upsamplingACM Transactions on Graphics, 2016
- DeepWarp: Photorealistic Image Resynthesis for Gaze ManipulationPublished by Springer Science and Business Media LLC ,2016
- Generative Visual Manipulation on the Natural Image ManifoldPublished by Springer Science and Business Media LLC ,2016
- Demo of Face2FacePublished by Association for Computing Machinery (ACM) ,2016
- Deep Learning Face Attributes in the WildPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- FaceNet: A unified embedding for face recognition and clusteringPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Visio-lizationACM Transactions on Graphics, 2009
- A Duality Based Approach for Realtime TV-L 1 Optical FlowPublished by Springer Science and Business Media LLC ,2007
- Face recognition using eigenfacesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Expressive expression mapping with ratio imagesPublished by Association for Computing Machinery (ACM) ,2001