2019/05/29 by Jianxin Lin, Yingce Xia, Lin, Jianxin +7 · 1 citation
Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
paper · pdf · doi:10.48550/arxiv.1905.12498
openalex publication_date 2019/05/29 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Image translation across different domains has attracted much attention in both machine learning and computer vision communities. Taking the translation from source domain Ds to target domain Dt as an example, existing algorithms mainly rely on two kinds of loss for training: One is the discrimination loss, which is used to differentiate images generated by the models and natural images; the other is the reconstruction loss, which measures the difference between an original image and the reconstructed version through Ds\toDt\toDs translation. In this work, we introduce a new kind of loss, multi-path consistency loss, which evaluates the differences between direct translation Ds\toDt and indirect translation Ds\toDa\toDt with Da as an auxiliary domain, to regularize training. For multi-domain translation (at least, three) which focuses on building translation models between any two domains, at each training iteration, we randomly select three domains, set them respectively as the source, auxiliary and target domains, build the multi-path consistency loss and optimize the network. For two-domain translation, we need to introduce an additional auxiliary domain and construct the multi-path consistency loss. We conduct various experiments to demonstrate the effectiveness of our proposed methods, including face-to-face translation, paint-to-photo translation, and de-raining/de-noising translation.