An IR-based facial expression tracking sensor for head-mounted displays

Jaekwang Cha; Jinhyuk Kim; Shiho Kim

doi:10.1109/ICSENS.2016.7808913

An IR-based facial expression tracking sensor for head-mounted displays

Jaekwang Cha, Jinhyuk Kim, Shiho Kim

School of Integrated Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

8 Citations (Scopus)

Abstract

We proposed an IR-based facial expression tracking sensor for Head-Mounted Displays(HMD). The proposed sensor uses lateral propagation characteristics of IR light on human skin to capture the degree of compressed or stretched deformations of facial skin. We derived a semi-empirical equation modeling the lateral propagation characteristics of vertically incident IR light into human skin, with parameters which fit to the measured data. All components of IR emitters and receivers were integrated into the form interface of a commercial VR headset. We verified the functionality of tracking performance from 4-kind of basic facial expressions in the experiment using the implemented prototype headset. As a further work, we will upgrade the performance of proposed sensor to recognize emotional expressions of HMD user by applying machine learning technique. We are aiming to enable immersive human to human(or avatar) communications in the cyberspace.

Original language	English
Title of host publication	IEEE Sensors, SENSORS 2016 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781479982875
DOIs	https://doi.org/10.1109/ICSENS.2016.7808913
Publication status	Published - 2016 Jan 5
Event	15th IEEE Sensors Conference, SENSORS 2016 - Orlando, United States Duration: 2016 Oct 30 → 2016 Nov 2

Publication series

Name	Proceedings of IEEE Sensors
Volume	0
ISSN (Print)	1930-0395
ISSN (Electronic)	2168-9229

Other

Other	15th IEEE Sensors Conference, SENSORS 2016
Country/Territory	United States
City	Orlando
Period	16/10/30 → 16/11/2

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

All Science Journal Classification (ASJC) codes

Electrical and Electronic Engineering

Access to Document

10.1109/ICSENS.2016.7808913

Cite this

@inproceedings{27ae06fddbbc4c118822559da40c1f3a,

title = "An IR-based facial expression tracking sensor for head-mounted displays",

abstract = "We proposed an IR-based facial expression tracking sensor for Head-Mounted Displays(HMD). The proposed sensor uses lateral propagation characteristics of IR light on human skin to capture the degree of compressed or stretched deformations of facial skin. We derived a semi-empirical equation modeling the lateral propagation characteristics of vertically incident IR light into human skin, with parameters which fit to the measured data. All components of IR emitters and receivers were integrated into the form interface of a commercial VR headset. We verified the functionality of tracking performance from 4-kind of basic facial expressions in the experiment using the implemented prototype headset. As a further work, we will upgrade the performance of proposed sensor to recognize emotional expressions of HMD user by applying machine learning technique. We are aiming to enable immersive human to human(or avatar) communications in the cyberspace.",

author = "Jaekwang Cha and Jinhyuk Kim and Shiho Kim",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 15th IEEE Sensors Conference, SENSORS 2016 ; Conference date: 30-10-2016 Through 02-11-2016",

year = "2016",

month = jan,

day = "5",

doi = "10.1109/ICSENS.2016.7808913",

language = "English",

series = "Proceedings of IEEE Sensors",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "IEEE Sensors, SENSORS 2016 - Proceedings",

address = "United States",

}

Cha, J, Kim, J & Kim, S 2016, An IR-based facial expression tracking sensor for head-mounted displays. in IEEE Sensors, SENSORS 2016 - Proceedings., 7808913, Proceedings of IEEE Sensors, vol. 0, Institute of Electrical and Electronics Engineers Inc., 15th IEEE Sensors Conference, SENSORS 2016, Orlando, United States, 16/10/30. https://doi.org/10.1109/ICSENS.2016.7808913

TY - GEN

T1 - An IR-based facial expression tracking sensor for head-mounted displays

AU - Cha, Jaekwang

AU - Kim, Jinhyuk

AU - Kim, Shiho

PY - 2016/1/5

Y1 - 2016/1/5

N2 - We proposed an IR-based facial expression tracking sensor for Head-Mounted Displays(HMD). The proposed sensor uses lateral propagation characteristics of IR light on human skin to capture the degree of compressed or stretched deformations of facial skin. We derived a semi-empirical equation modeling the lateral propagation characteristics of vertically incident IR light into human skin, with parameters which fit to the measured data. All components of IR emitters and receivers were integrated into the form interface of a commercial VR headset. We verified the functionality of tracking performance from 4-kind of basic facial expressions in the experiment using the implemented prototype headset. As a further work, we will upgrade the performance of proposed sensor to recognize emotional expressions of HMD user by applying machine learning technique. We are aiming to enable immersive human to human(or avatar) communications in the cyberspace.

AB - We proposed an IR-based facial expression tracking sensor for Head-Mounted Displays(HMD). The proposed sensor uses lateral propagation characteristics of IR light on human skin to capture the degree of compressed or stretched deformations of facial skin. We derived a semi-empirical equation modeling the lateral propagation characteristics of vertically incident IR light into human skin, with parameters which fit to the measured data. All components of IR emitters and receivers were integrated into the form interface of a commercial VR headset. We verified the functionality of tracking performance from 4-kind of basic facial expressions in the experiment using the implemented prototype headset. As a further work, we will upgrade the performance of proposed sensor to recognize emotional expressions of HMD user by applying machine learning technique. We are aiming to enable immersive human to human(or avatar) communications in the cyberspace.

UR - http://www.scopus.com/inward/record.url?scp=85010961035&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85010961035&partnerID=8YFLogxK

U2 - 10.1109/ICSENS.2016.7808913

DO - 10.1109/ICSENS.2016.7808913

M3 - Conference contribution

AN - SCOPUS:85010961035

T3 - Proceedings of IEEE Sensors

BT - IEEE Sensors, SENSORS 2016 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 15th IEEE Sensors Conference, SENSORS 2016

Y2 - 30 October 2016 through 2 November 2016

ER -

An IR-based facial expression tracking sensor for head-mounted displays

Abstract

Publication series

Other

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this