An IR-based facial expression tracking sensor for head-mounted displays

Jaekwang Cha, Jinhyuk Kim, Shiho Kim

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)


We proposed an IR-based facial expression tracking sensor for Head-Mounted Displays(HMD). The proposed sensor uses lateral propagation characteristics of IR light on human skin to capture the degree of compressed or stretched deformations of facial skin. We derived a semi-empirical equation modeling the lateral propagation characteristics of vertically incident IR light into human skin, with parameters which fit to the measured data. All components of IR emitters and receivers were integrated into the form interface of a commercial VR headset. We verified the functionality of tracking performance from 4-kind of basic facial expressions in the experiment using the implemented prototype headset. As a further work, we will upgrade the performance of proposed sensor to recognize emotional expressions of HMD user by applying machine learning technique. We are aiming to enable immersive human to human(or avatar) communications in the cyberspace.

Original languageEnglish
Title of host publicationIEEE Sensors, SENSORS 2016 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479982875
Publication statusPublished - 2016 Jan 5
Event15th IEEE Sensors Conference, SENSORS 2016 - Orlando, United States
Duration: 2016 Oct 302016 Nov 2

Publication series

NameProceedings of IEEE Sensors
ISSN (Print)1930-0395
ISSN (Electronic)2168-9229


Other15th IEEE Sensors Conference, SENSORS 2016
Country/TerritoryUnited States

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering


Dive into the research topics of 'An IR-based facial expression tracking sensor for head-mounted displays'. Together they form a unique fingerprint.

Cite this