{"id":1411,"date":"2022-01-06T10:57:31","date_gmt":"2022-01-06T02:57:31","guid":{"rendered":"http:\/\/139.9.1.231\/?p=1411"},"modified":"2022-01-06T10:57:32","modified_gmt":"2022-01-06T02:57:32","slug":"stargan","status":"publish","type":"post","link":"http:\/\/139.9.1.231\/index.php\/2022\/01\/06\/stargan\/","title":{"rendered":"GAN\u7cfb\u5217\u4e4b StarGAN"},"content":{"rendered":"\n

StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation<\/em><\/p>\n\n\n\n

Authors<\/h4>\n\n\n\n

Yunjey Choi, Minje Choi, Munyoung Kim, Jung-Woo Ha, Sunghun Kim, Jaegul Choo<\/p>\n\n\n\n

Abstract<\/h4>\n\n\n\n

Recent studies have shown remarkable success in image-to-image translation for two domains. However, existing approaches have limited scalability and robustness in handling more than two domains, since different models should be built independently for every pair of image domains. To address this limitation, we propose StarGAN, a novel and scalable approach that can perform image-to-image translations for multiple domains using only a single model. Such a unified model architecture of StarGAN allows simultaneous training of multiple datasets with different domains within a single network. This leads to StarGAN’s superior quality of translated images compared to existing models as well as the novel capability of flexibly translating an input image to any desired target domain. We empirically demonstrate the effectiveness of our approach on a facial attribute transfer and a facial expression synthesis tasks.<\/p>\n\n\n\n

Pix2Pix\u6a21\u578b\u89e3\u51b3\u4e86\u6709Pair\u5bf9\u6570\u636e\u7684\u56fe\u50cf\u7ffb\u8bd1\u95ee\u9898\uff1bCycleGAN\u89e3\u51b3\u4e86Unpaired\u6570\u636e\u4e0b\u7684\u56fe\u50cf\u7ffb\u8bd1\u95ee\u9898\u3002\u4f46\u65e0\u8bba\u662fPix2Pix\u8fd8\u662fCycleGAN\uff0c\u90fd\u662f\u89e3\u51b3\u4e86\u4e00\u5bf9\u4e00\u7684\u95ee\u9898\uff0c\u5373\u4e00\u4e2a\u9886\u57df\u5230\u53e6\u4e00\u4e2a\u9886\u57df\u7684\u8f6c\u6362\u3002\u5f53\u6709\u5f88\u591a\u9886\u57df\u8981\u8f6c\u6362\u4e86\uff0c\u5bf9\u4e8e\u6bcf\u4e00\u4e2a\u9886\u57df\u8f6c\u6362\uff0c\u90fd\u9700\u8981\u91cd\u65b0\u8bad\u7ec3\u4e00\u4e2a\u6a21\u578b\u53bb\u89e3\u51b3\u3002\u8fd9\u6837\u7684\u884c\u4e3a\u592a\u4f4e\u6548\u4e86\u3002\u672c\u6587\u6240\u4ecb\u7ecd\u7684StarGAN\u5c31\u662f\u5c06\u591a\u9886\u57df\u8f6c\u6362\u7528\u7edf\u4e00\u6846\u67b6\u5b9e\u73b0\u7684\u7b97\u6cd5\u3002<\/p>\n\n\n\n

\u4e0b\u56fe\u662fStarGAN\u7684\u6548\u679c\uff0c\u5728\u540c\u4e00\u79cd\u6a21\u578b\u4e0b\uff0c\u53ef\u4ee5\u505a\u591a\u4e2a\u56fe\u50cf\u7ffb\u8bd1\u4efb\u52a1\uff0c\u6bd4\u5982\u66f4\u6362\u5934\u53d1\u989c\u8272\uff0c\u66f4\u6362\u8868\u60c5\uff0c\u66f4\u6362\u5e74\u9f84\u7b49\u3002<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

StarGAN\uff0c\u987e\u540d\u601d\u4e49\uff0c\u5c31\u662f\u661f\u5f62\u7f51\u7edc\u7ed3\u6784\uff0c\u5728StarGAN\u4e2d\uff0c\u751f\u6210\u7f51\u7edcG\u88ab\u5b9e\u73b0\u6210\u661f\u5f62\u3002<\/p>\n\n\n\n

1.CycleGAN \u4e0d\u80fd\u89e3\u51b3\u591a\u9886\u57df\u8fc1\u79fb\u7684\u95ee\u9898\u3002 \u53ea\u80fd\u4e24\u4e2a\u9886\u57df\u7684\u4e92\u76f8\u8f6c\u5316A->B,B-A\u3002 \u4f46\u662f\u5b9e\u9645\u573a\u666f\u4e2d\uff0c\u6211\u4eec\u53ef\u80fd\u9047\u5230 \u591a\u4e2a\u6570\u636e\u96c6\uff0c\u6216\u8005\u591a\u79cd\u5c5e\u6027\u7684\u4e92\u76f8\u8f6c\u5316\u7684\u8981\u6c42\u3002\u8fd9\u6837\u7684\u8bdd\u6211\u4eec\u5c31\u9700\u8981O(n^2)\u7684G model\u3002\uff08\u5982\u4e0b\u56fe\uff09<\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

2.\u6709\u4e9b\u5c5e\u6027\uff08\u5982\u4eba\u7684\u8868\u60c5\uff09\uff0c\u5982\u679c\u53ea\u53d6\u5176\u4e2d\u7684\u4e24\u4e2a\u5c5e\u6027\uff08\u7b11\u548c\u4e0d\u7b11\uff09\uff0c\u90a3\u4e48\u5c31\u65e0\u6cd5\u5229\u7528\u4e0a\u5176\u4ed6\u8bad\u7ec3\u6570\u636e\uff08\u6bd4\u5982\u751f\u6c14\/\u6050\u60e7\u7b49\u8868\u60c5\u6570\u636e\uff09\u3002<\/p>\n\n\n\n

1.\u4f5c\u8005\u63d0\u51fa\u4e86StarGAN \u6765\u5904\u7406\u591a\u4e2adomain\u4e4b\u95f4\u4e92\u76f8generate\u56fe\u50cf \u7684\u95ee\u9898\u3002\u53ea\u7528\u4e00\u4e2agenerator\u7f51\u7edc\u3002<\/p>\n\n\n\n

\u5047\u5982\u60f3\u5b9e\u73b0\u56db\u4e2a\u57df\u5185\u56fe\u50cf\u98ce\u683c\u7684\u76f8\u4e92\u8f6c\u6362\uff0c\u8981\u5b9e\u73b0\u8fd9\u4e2a\u76ee\u6807\uff0c\u901a\u8fc7cycleGAN\u9700\u8981\u521b\u5efa12\u4e2a\u751f\u6210\u5668\uff08\u5982\u56fea\uff09\u3002\u800cstarGAN\u7684\u76f4\u89c2\u6784\u9020\u5982\u56feb\uff0c\u53ea\u9700\u8981\u4e00\u4e2a\u751f\u6210\u5668\u5373\u53ef\u3002<\/p>\n\n\n\n

\"\"\/<\/figure><\/div>\n\n\n\n

2. G\u7684\u8f93\u5165\u9664\u4e86\u56fe\u7247\uff0c\u8fd8\u6709domain\u7684label\uff0c\u5bf9\u5e94\u7684\u628a\u751f\u6210\u56fe\u7247\u53d8\u5230\u6307\u5b9a\u7684domain\u3002<\/p>\n\n\n\n

starGAN\u7684\u63d0\u51fa\u662f\u4e3a\u4e86\u89e3\u51b3\u591a\u6570\u636e\u96c6\u5728\u591a\u57df\u95f4\u56fe\u50cf\u8f6c\u6362\u7684\u95ee\u9898\uff0cstarGAN\u53ef\u4ee5\u63a5\u53d7\u591a\u4e2a\u4e0d\u540c\u57df\u7684\u8bad\u7ec3\u6570\u636e\uff0c\u5e76\u4e14\u53ea\u9700\u8981\u8bad\u7ec3\u4e00\u4e2a\u751f\u6210\u5668\uff0c\u5c31\u53ef\u4ee5\u62df\u5408\u6240\u6709\u53ef\u7528\u57df\u4e2d\u7684\u6570\u636e\u3002<\/p>\n\n\n\n

StarGAN\u7684\u5927\u81f4\u8bad\u7ec3\u6d41\u7a0b<\/strong>\uff1a<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

i\uff09\u5982\u56fea\uff0c\u8bad\u7ec3\u5224\u522b\u5668\uff0c\u5c06 real_img \u548c fake_img \u5206\u522b\u4f20\u9012\u7ed9\u5224\u522b\u5668\uff0c\u5224\u522b\u5668\u4f1a\u5224\u522b\u56fe\u50cf\u7684\u771f\u5047\uff0c\u540c\u65f6\u5b83\u8fd8\u4f1a\u5224\u522b\u8be5\u56fe\u50cf\u6765\u81ea\u54ea\u4e2a\u57df\uff08\u53ea\u5bf9real_img \u7684label\u505a\u5224\u522b\uff09\u3002
ii\uff09\u5982\u56feb\uff0c\u8bad\u7ec3\u751f\u6210\u5668\uff0c\u4e0eCGAN\u7c7b\u4f3c\uff0c\u8fd9\u91cc\u9664\u4e86\u8f93\u5165\u56fe\u50cf\u5916\uff0c\u8fd8\u8981\u8f93\u5165\u8be5\u56fe\u50cf\u60f3\u8f6c\u6362\u7684\u76ee\u6807\u57df\uff0c\u8fd9\u4e2a\u76ee\u6807\u57df\u7c7b\u4f3c\u4e8e\u7ea6\u675f\u6761\u4ef6\uff0c\u5b83\u8981\u6c42\u751f\u6210\u5668\u5c3d\u53ef\u80fd\u53bb\u751f\u6210\u8be5\u76ee\u6807\u57df\u4e2d\u7684\u56fe\u50cf\u3002
iii\uff09\u5982\u56fec\uff0c\u8868\u793a\u5faa\u73af\u4e00\u81f4\u6027\u7684\u8fc7\u7a0b\uff0c\u5982\u679c\u53ea\u662f\u5355\u7eaf\u7684\u4f7f\u7528\u6761\u4ef6\u53bb\u63a7\u5236\u751f\u6210\u5668\u751f\u6210\uff0c\u90a3\u4e48\u751f\u6210\u5668\u5c31\u4f1a\u751f\u6210\u6ee1\u8db3\u6761\u4ef6\u4f46\u53ef\u80fd\u4e0e\u8f93\u5165\u56fe\u50cf\u65e0\u5173\u7684\u6570\u636e\uff0c\u4e3a\u4e86\u907f\u514d\u8fd9\u79cd\u60c5\u51b5\uff0c\u4fbf\u4f7f\u7528\u5faa\u73af\u4e00\u81f4\u6027\u7684\u601d\u60f3\uff0c\u5373\u5c06\u751f\u6210\u7684\u56fe\u50cf\u52a0\u4e0a\u8f93\u5165\u56fe\u50cf\u6240\u5728\u7684\u57df\u4f5c\u4e3a\u751f\u6210\u5668\u7684\u8f93\u5165\uff0c\u5e0c\u671b\u83b7\u5f97\u7684\u8f93\u51fa\u4e0e\u539f\u8f93\u5165\u56fe\u50cf\u8d8a\u63a5\u8fd1\u8d8a\u597d\u3002
iiii\uff09\u5982\u56fed\uff0c\u8868\u793a\u8bad\u7ec3\u751f\u6210\u5668\uff0c\u5373\u5c06\u751f\u6210\u5668\u751f\u6210\u7684\u56fe\u7247\u4ea4\u7ed9\u5224\u522b\u5668\uff0c\u8ba9\u5224\u522b\u5668\u5224\u522b\u56fe\u50cf\u7684\u771f\u5047\u4ee5\u53ca\u56fe\u50cf\u6240\u5728\u7684\u57df\u662f\u5426\u6b63\u786e\u3002<\/p>\n\n\n\n

\u635f\u5931\u51fd\u6570\uff1a<\/p>\n\n\n\n

Adversarial loss \u4e3a conditional gan\u5e38\u7528\u7684\u3002\uff08\u5b9e\u9645\u66ff\u6362\u4e3aWGAN\u7684loss\uff09<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Reconstruction loss \u4e3aL1 Loss \uff08\u548cCyclegan\u4e00\u6837\uff09<\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

Domain classification loss(\u5c5e\u6027\u5206\u7c7b)\u5c31\u662f\u4f20\u7edf\u5206\u7c7blog NLLloss\u3002<\/p>\n\n\n\n

\u7c7b\u522b\u635f\u5931\uff0c\u8be5\u635f\u5931\u88ab\u5206\u6210\u4e24\u4e2a\uff0c\u8bad\u7ec3D\u7684\u65f6\u5019\uff0c\u4f7f\u7528\u771f\u5b9e\u56fe\u50cf\u5728\u539f\u59cb\u9886\u57df\u8fdb\u884c\uff0c\u8bad\u7ec3G\u7684\u65f6\u5019\uff0c\u4f7f\u7528\u751f\u6210\u7684\u56fe\u50cf\u5728\u76ee\u6807\u9886\u57df\u8fdb\u884c\u3002<\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n
\"\"<\/figure><\/div>\n\n\n\n
\"\"<\/figure>\n\n\n\n

\u591a\u6570\u636e\u96c6\u8bad\u7ec3
\u5728\u591a\u6570\u636e\u96c6\u4e0b\u8bad\u7ec3StarGAN\u5b58\u5728\u4e00\u4e2a\u95ee\u9898\uff0c\u90a3\u5c31\u662f\u6570\u636e\u96c6\u4e4b\u95f4\u7684\u7c7b\u522b\u53ef\u80fd\u662f\u4e0d\u76f8\u4ea4\u7684\uff0c\u4f46\u5185\u5bb9\u53ef\u80fd\u662f\u76f8\u4ea4\u7684\u3002\u6bd4\u5982CelebA\u6570\u636e\u96c6\u5408RaFD\u6570\u636e\u96c6\uff0c\u524d\u8005\u62e5\u6709\u5f88\u591a\u80a4\u8272\uff0c\u5e74\u9f84\u4e4b\u7c7b\u7684\u7c7b\u522b\u3002\u800c\u540e\u8005\u62e5\u6709\u7684\u662f\u8868\u60c5\u7684\u7c7b\u522b\u3002\u4f46\u524d\u8005\u7684\u56fe\u50cf\u5f88\u591a\u4e5f\u662f\u6709\u8868\u60c5\u7684\uff0c\u8fd9\u5c31\u5bfc\u81f4\u524d\u4e00\u7c7b\u7684\u56fe\u50cf\u5728\u540e\u4e00\u7c7b\u7684\u6807\u8bb0\u662f\u4e0d\u53ef\u77e5\u7684\u3002<\/p>\n\n\n\n

\u4e3a\u4e86\u89e3\u51b3\u8fd9\u4e2a\u95ee\u9898\uff0c\u5728\u6a21\u578b\u8f93\u5165\u4e2d\u52a0\u5165\u4e86Mask\uff0c\u5373\u5982\u679c\u6765\u6e90\u4e8e\u6570\u636e\u96c6B\uff0c\u90a3\u4e48\u5c06\u6570\u636e\u96c6A\u4e2d\u7684\u6807\u8bb0\u5168\u90e8\u8bbe\u4e3a0.<\/p>\n","protected":false},"excerpt":{"rendered":"

StarGAN: Unified Generative Adversarial Networks for Mu … \u7ee7\u7eed\u9605\u8bfbGAN\u7cfb\u5217\u4e4b StarGAN<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4,12],"tags":[],"_links":{"self":[{"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/posts\/1411"}],"collection":[{"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/comments?post=1411"}],"version-history":[{"count":5,"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/posts\/1411\/revisions"}],"predecessor-version":[{"id":1424,"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/posts\/1411\/revisions\/1424"}],"wp:attachment":[{"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/media?parent=1411"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/categories?post=1411"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/139.9.1.231\/index.php\/wp-json\/wp\/v2\/tags?post=1411"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}