Emotion recognition in gamers wearing head-mounted display

Hwanmoo Yong; Jisuk Lee; Jongeun Choi

doi:10.1109/VR.2019.8797736

Emotion recognition in gamers wearing head-mounted display

Hwanmoo Yong, Jisuk Lee, Jongeun Choi

Department of Mechanical Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

10 Citations (Scopus)

Abstract

Wearing head-mounted display (HMD) makes previous research regarding emotion recognition using machine vision ineffective since they utilized entire face images for training. In this paper, we trained the convolutional neural networks (CNNs) which are capable of estimating the emotions from the images of a face wearing a HMD by hiding eyes and eyebrows from existing face-emotion dataset. Our analysis based on the class activation maps show that it is capable of classifying emotions without the eyes and the eyebrows which ar to serve useful information in recognizing emotions. This implies the possibility of estimating the emotions from the images of humans wearing HMDs using machine vision.

Original language	English
Title of host publication	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1251-1252
Number of pages	2
ISBN (Electronic)	9781728113777
DOIs	https://doi.org/10.1109/VR.2019.8797736
Publication status	Published - 2019 Mar
Event	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Osaka, Japan Duration: 2019 Mar 23 → 2019 Mar 27

Publication series

Name	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

Conference

Conference	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019
Country/Territory	Japan
City	Osaka
Period	19/3/23 → 19/3/27

Bibliographical note

Funding Information:
This work was supported by the National Research Foundation of Korea (NRF) Grant funded by the Korea govenment (MSIT) under Grant 2018R1A4A1025986. Additionally, this work was supported by the Ministry of Trade, Industry and Energy (MOTIE) and the Korea Institue for the Advancement of Technology (KIAT) (N0002385, 2017).

Publisher Copyright:
© 2019 IEEE.

All Science Journal Classification (ASJC) codes

Human-Computer Interaction
Media Technology

Access to Document

10.1109/VR.2019.8797736

Cite this

Yong, H., Lee, J., & Choi, J. (2019). Emotion recognition in gamers wearing head-mounted display. In 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings (pp. 1251-1252). [8797736] (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VR.2019.8797736

@inproceedings{f12bfd4eae2049b194034d03f79fb609,

title = "Emotion recognition in gamers wearing head-mounted display",

abstract = "Wearing head-mounted display (HMD) makes previous research regarding emotion recognition using machine vision ineffective since they utilized entire face images for training. In this paper, we trained the convolutional neural networks (CNNs) which are capable of estimating the emotions from the images of a face wearing a HMD by hiding eyes and eyebrows from existing face-emotion dataset. Our analysis based on the class activation maps show that it is capable of classifying emotions without the eyes and the eyebrows which ar to serve useful information in recognizing emotions. This implies the possibility of estimating the emotions from the images of humans wearing HMDs using machine vision.",

author = "Hwanmoo Yong and Jisuk Lee and Jongeun Choi",

note = "Funding Information: This work was supported by the National Research Foundation of Korea (NRF) Grant funded by the Korea govenment (MSIT) under Grant 2018R1A4A1025986. Additionally, this work was supported by the Ministry of Trade, Industry and Energy (MOTIE) and the Korea Institue for the Advancement of Technology (KIAT) (N0002385, 2017). Publisher Copyright: {\textcopyright} 2019 IEEE.; 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 ; Conference date: 23-03-2019 Through 27-03-2019",

year = "2019",

month = mar,

doi = "10.1109/VR.2019.8797736",

language = "English",

series = "26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1251--1252",

booktitle = "26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings",

address = "United States",

}

Yong, H, Lee, J & Choi, J 2019, Emotion recognition in gamers wearing head-mounted display. in 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings., 8797736, 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 1251-1252, 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019, Osaka, Japan, 19/3/23. https://doi.org/10.1109/VR.2019.8797736

Emotion recognition in gamers wearing head-mounted display. / Yong, Hwanmoo; Lee, Jisuk; Choi, Jongeun.
26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1251-1252 8797736 (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Emotion recognition in gamers wearing head-mounted display

AU - Yong, Hwanmoo

AU - Lee, Jisuk

AU - Choi, Jongeun

N1 - Funding Information: This work was supported by the National Research Foundation of Korea (NRF) Grant funded by the Korea govenment (MSIT) under Grant 2018R1A4A1025986. Additionally, this work was supported by the Ministry of Trade, Industry and Energy (MOTIE) and the Korea Institue for the Advancement of Technology (KIAT) (N0002385, 2017). Publisher Copyright: © 2019 IEEE.

PY - 2019/3

Y1 - 2019/3

N2 - Wearing head-mounted display (HMD) makes previous research regarding emotion recognition using machine vision ineffective since they utilized entire face images for training. In this paper, we trained the convolutional neural networks (CNNs) which are capable of estimating the emotions from the images of a face wearing a HMD by hiding eyes and eyebrows from existing face-emotion dataset. Our analysis based on the class activation maps show that it is capable of classifying emotions without the eyes and the eyebrows which ar to serve useful information in recognizing emotions. This implies the possibility of estimating the emotions from the images of humans wearing HMDs using machine vision.

AB - Wearing head-mounted display (HMD) makes previous research regarding emotion recognition using machine vision ineffective since they utilized entire face images for training. In this paper, we trained the convolutional neural networks (CNNs) which are capable of estimating the emotions from the images of a face wearing a HMD by hiding eyes and eyebrows from existing face-emotion dataset. Our analysis based on the class activation maps show that it is capable of classifying emotions without the eyes and the eyebrows which ar to serve useful information in recognizing emotions. This implies the possibility of estimating the emotions from the images of humans wearing HMDs using machine vision.

UR - http://www.scopus.com/inward/record.url?scp=85071860333&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85071860333&partnerID=8YFLogxK

U2 - 10.1109/VR.2019.8797736

DO - 10.1109/VR.2019.8797736

M3 - Conference contribution

AN - SCOPUS:85071860333

T3 - 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

SP - 1251

EP - 1252

BT - 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019

Y2 - 23 March 2019 through 27 March 2019

ER -

Yong H, Lee J, Choi J. Emotion recognition in gamers wearing head-mounted display. In 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1251-1252. 8797736. (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings). doi: 10.1109/VR.2019.8797736

Emotion recognition in gamers wearing head-mounted display

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this