Efficient Bokeh Effect Rendering using Generative Adversarial Network

Min Su Choi; Jun Hyuk Kim; Jun Ho Choi; Jong Seok Lee

doi:10.1109/ICCE-Asia49877.2020.9276807

Efficient Bokeh Effect Rendering using Generative Adversarial Network

Min Su Choi, Jun Hyuk Kim, Jun Ho Choi, Jong Seok Lee

School of Integrated Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

Abstract

The bokeh effect in photography is an artistic effect that makes the subject stand out by intentionally distorting the focus of the background while focusing on the subject. In this paper, we propose an end-to-end deep learning model that generates bokeh images from wild HD images. The proposed generative adversarial network model consists of a generator and a double-scale discriminator. It is so lightweight that it can carry out bokeh effect rendering in 0.03 seconds per image on a PC. In addition, we show that in a mobile environment, HD images can be processed in 1.3 seconds per image.

Original language	English
Title of host publication	2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728161648
DOIs	https://doi.org/10.1109/ICCE-Asia49877.2020.9276807
Publication status	Published - 2020 Nov 1
Event	2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020 - Seoul, Korea, Republic of Duration: 2020 Nov 1 → 2020 Nov 3

Publication series

Name	2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020

Conference

Conference	2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020
Country/Territory	Korea, Republic of
City	Seoul
Period	20/11/1 → 20/11/3

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

All Science Journal Classification (ASJC) codes

Computer Science Applications
Electrical and Electronic Engineering
Media Technology
Instrumentation

Access to Document

10.1109/ICCE-Asia49877.2020.9276807

Cite this

Choi, M. S., Kim, J. H., Choi, J. H., & Lee, J. S. (2020). Efficient Bokeh Effect Rendering using Generative Adversarial Network. In 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020 Article 9276807 (2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCE-Asia49877.2020.9276807

@inproceedings{3b29c695eeca47a9b9b4e86c99234a06,

title = "Efficient Bokeh Effect Rendering using Generative Adversarial Network",

abstract = "The bokeh effect in photography is an artistic effect that makes the subject stand out by intentionally distorting the focus of the background while focusing on the subject. In this paper, we propose an end-to-end deep learning model that generates bokeh images from wild HD images. The proposed generative adversarial network model consists of a generator and a double-scale discriminator. It is so lightweight that it can carry out bokeh effect rendering in 0.03 seconds per image on a PC. In addition, we show that in a mobile environment, HD images can be processed in 1.3 seconds per image.",

keywords = "MobileNet, bokeh effect, feature pyramid network, generative adversarial networks",

author = "Choi, {Min Su} and Kim, {Jun Hyuk} and Choi, {Jun Ho} and Lee, {Jong Seok}",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020 ; Conference date: 01-11-2020 Through 03-11-2020",

year = "2020",

month = nov,

day = "1",

doi = "10.1109/ICCE-Asia49877.2020.9276807",

language = "English",

series = "2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020",

address = "United States",

}

Choi, MS, Kim, JH, Choi, JH & Lee, JS 2020, Efficient Bokeh Effect Rendering using Generative Adversarial Network. in 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020., 9276807, 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020, Institute of Electrical and Electronics Engineers Inc., 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020, Seoul, Korea, Republic of, 20/11/1. https://doi.org/10.1109/ICCE-Asia49877.2020.9276807

Efficient Bokeh Effect Rendering using Generative Adversarial Network. / Choi, Min Su; Kim, Jun Hyuk; Choi, Jun Ho et al.
2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020. Institute of Electrical and Electronics Engineers Inc., 2020. 9276807 (2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Efficient Bokeh Effect Rendering using Generative Adversarial Network

AU - Choi, Min Su

AU - Kim, Jun Hyuk

AU - Choi, Jun Ho

AU - Lee, Jong Seok

PY - 2020/11/1

Y1 - 2020/11/1

N2 - The bokeh effect in photography is an artistic effect that makes the subject stand out by intentionally distorting the focus of the background while focusing on the subject. In this paper, we propose an end-to-end deep learning model that generates bokeh images from wild HD images. The proposed generative adversarial network model consists of a generator and a double-scale discriminator. It is so lightweight that it can carry out bokeh effect rendering in 0.03 seconds per image on a PC. In addition, we show that in a mobile environment, HD images can be processed in 1.3 seconds per image.

AB - The bokeh effect in photography is an artistic effect that makes the subject stand out by intentionally distorting the focus of the background while focusing on the subject. In this paper, we propose an end-to-end deep learning model that generates bokeh images from wild HD images. The proposed generative adversarial network model consists of a generator and a double-scale discriminator. It is so lightweight that it can carry out bokeh effect rendering in 0.03 seconds per image on a PC. In addition, we show that in a mobile environment, HD images can be processed in 1.3 seconds per image.

KW - MobileNet

KW - bokeh effect

KW - feature pyramid network

KW - generative adversarial networks

UR - http://www.scopus.com/inward/record.url?scp=85098861758&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85098861758&partnerID=8YFLogxK

U2 - 10.1109/ICCE-Asia49877.2020.9276807

DO - 10.1109/ICCE-Asia49877.2020.9276807

M3 - Conference contribution

AN - SCOPUS:85098861758

T3 - 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020

BT - 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020

Y2 - 1 November 2020 through 3 November 2020

ER -

Choi MS, Kim JH, Choi JH, Lee JS. Efficient Bokeh Effect Rendering using Generative Adversarial Network. In 2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9276807. (2020 IEEE International Conference on Consumer Electronics - Asia, ICCE-Asia 2020). doi: 10.1109/ICCE-Asia49877.2020.9276807

Efficient Bokeh Effect Rendering using Generative Adversarial Network

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this