Semantic attribute matching networks

Seungryong Kim; Dongbo Min; Somi Jeong; Sunok Kim; Sangryul Jeon; Kwanghoon Sohn

doi:10.1109/CVPR.2019.01262

Semantic attribute matching networks

Seungryong Kim, Dongbo Min, Somi Jeong, Sunok Kim, Sangryul Jeon, Kwanghoon Sohn

Department of Electrical and Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

25 Citations (Scopus)

Abstract

We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming their limitations. SAM-Net accomplishes this through an iterative process of establishing reliable correspondences by reducing the attribute discrepancy between the images and synthesizing attribute transferred images using the learned correspondences. To learn the networks using weak supervisions in the form of image pairs, we present a semantic attribute matching loss based on the matching similarity between an attribute transferred source feature and a warped target feature. With SAM-Net, the state-of-the-art performance is attained on several benchmarks for semantic matching and attribute transfer.

Original language	English
Title of host publication	Proceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019
Publisher	IEEE Computer Society
Pages	12331-12340
Number of pages	10
ISBN (Electronic)	9781728132938
DOIs	https://doi.org/10.1109/CVPR.2019.01262
Publication status	Published - 2019 Jun
Event	32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019 - Long Beach, United States Duration: 2019 Jun 16 → 2019 Jun 20

Publication series

Name	Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume	2019-June
ISSN (Print)	1063-6919

Conference

Conference	32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019
Country/Territory	United States
City	Long Beach
Period	19/6/16 → 19/6/20

Bibliographical note

Funding Information:
This research was supported by R&D program for Advanced Integrated-intelligenceforIdentification(AIID)throughtheNationalRe-searchFoundationofKOREA (NRF)fundedbyMinistryofScienceand ICT(NRF-2018M3E3A1057289). ∗Correspondingauthor

Publisher Copyright:
© 2019 IEEE.

All Science Journal Classification (ASJC) codes

Software
Computer Vision and Pattern Recognition

Access to Document

10.1109/CVPR.2019.01262

Cite this

Kim, S., Min, D., Jeong, S., Kim, S., Jeon, S., & Sohn, K. (2019). Semantic attribute matching networks. In Proceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019 (pp. 12331-12340). Article 8953730 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2019-June). IEEE Computer Society. https://doi.org/10.1109/CVPR.2019.01262

@inproceedings{6820cb2de8314df383c9b37c2649d5ee,

title = "Semantic attribute matching networks",

abstract = "We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming their limitations. SAM-Net accomplishes this through an iterative process of establishing reliable correspondences by reducing the attribute discrepancy between the images and synthesizing attribute transferred images using the learned correspondences. To learn the networks using weak supervisions in the form of image pairs, we present a semantic attribute matching loss based on the matching similarity between an attribute transferred source feature and a warped target feature. With SAM-Net, the state-of-the-art performance is attained on several benchmarks for semantic matching and attribute transfer.",

author = "Seungryong Kim and Dongbo Min and Somi Jeong and Sunok Kim and Sangryul Jeon and Kwanghoon Sohn",

note = "Funding Information: This research was supported by R&D program for Advanced Integrated-intelligenceforIdentification(AIID)throughtheNationalRe-searchFoundationofKOREA (NRF)fundedbyMinistryofScienceand ICT(NRF-2018M3E3A1057289). ∗Correspondingauthor Publisher Copyright: {\textcopyright} 2019 IEEE.; 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019 ; Conference date: 16-06-2019 Through 20-06-2019",

year = "2019",

month = jun,

doi = "10.1109/CVPR.2019.01262",

language = "English",

series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",

publisher = "IEEE Computer Society",

pages = "12331--12340",

booktitle = "Proceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019",

address = "United States",

}

Kim, S, Min, D, Jeong, S, Kim, S, Jeon, S & Sohn, K 2019, Semantic attribute matching networks. in Proceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019., 8953730, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2019-June, IEEE Computer Society, pp. 12331-12340, 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, United States, 19/6/16. https://doi.org/10.1109/CVPR.2019.01262

Semantic attribute matching networks. / Kim, Seungryong; Min, Dongbo; Jeong, Somi et al.
Proceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019. IEEE Computer Society, 2019. p. 12331-12340 8953730 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 2019-June).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Semantic attribute matching networks

AU - Kim, Seungryong

AU - Min, Dongbo

AU - Jeong, Somi

AU - Kim, Sunok

AU - Jeon, Sangryul

AU - Sohn, Kwanghoon

N1 - Funding Information: This research was supported by R&D program for Advanced Integrated-intelligenceforIdentification(AIID)throughtheNationalRe-searchFoundationofKOREA (NRF)fundedbyMinistryofScienceand ICT(NRF-2018M3E3A1057289). ∗Correspondingauthor Publisher Copyright: © 2019 IEEE.

PY - 2019/6

Y1 - 2019/6

N2 - We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming their limitations. SAM-Net accomplishes this through an iterative process of establishing reliable correspondences by reducing the attribute discrepancy between the images and synthesizing attribute transferred images using the learned correspondences. To learn the networks using weak supervisions in the form of image pairs, we present a semantic attribute matching loss based on the matching similarity between an attribute transferred source feature and a warped target feature. With SAM-Net, the state-of-the-art performance is attained on several benchmarks for semantic matching and attribute transfer.

AB - We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming their limitations. SAM-Net accomplishes this through an iterative process of establishing reliable correspondences by reducing the attribute discrepancy between the images and synthesizing attribute transferred images using the learned correspondences. To learn the networks using weak supervisions in the form of image pairs, we present a semantic attribute matching loss based on the matching similarity between an attribute transferred source feature and a warped target feature. With SAM-Net, the state-of-the-art performance is attained on several benchmarks for semantic matching and attribute transfer.

UR - http://www.scopus.com/inward/record.url?scp=85078720831&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85078720831&partnerID=8YFLogxK

U2 - 10.1109/CVPR.2019.01262

DO - 10.1109/CVPR.2019.01262

M3 - Conference contribution

AN - SCOPUS:85078720831

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

SP - 12331

EP - 12340

BT - Proceedings - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019

PB - IEEE Computer Society

T2 - 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2019

Y2 - 16 June 2019 through 20 June 2019

ER -

Semantic attribute matching networks

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this