Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface

Jaekwang Cha; Jinhyuk Kim; Shiho Kim

doi:10.1109/ISOCC50952.2020.9333101

Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface

Jaekwang Cha, Jinhyuk Kim, Shiho Kim

School of Integrated Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We propose a novel type of near-infrared (NIR) based sensory system for the detection of skin deformation induced by facial expressions. The proposed system utilizes the diffusion property which was called spatially resolved diffuse reflectance of NIR light in human skin as clues of detecting skin deformations. The sensor was mainly composed of NIR laser diode and a camera as a light source and receiver. To refine the information from captured IR raw images, we exploited principal component analysis based preprocessing procedure. By producing sensor data collecting experiment on several participants, we've verified the facial deformation tracking performance of the proposed sensory system.

Original language	English
Title of host publication	Proceedings - International SoC Design Conference, ISOCC 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	342-343
Number of pages	2
ISBN (Electronic)	9781728183312
DOIs	https://doi.org/10.1109/ISOCC50952.2020.9333101
Publication status	Published - 2020 Oct 21
Event	17th International System-on-Chip Design Conference, ISOCC 2020 - Yeosu, Korea, Republic of Duration: 2020 Oct 21 → 2020 Oct 24

Publication series

Name	Proceedings - International SoC Design Conference, ISOCC 2020

Conference

Conference	17th International System-on-Chip Design Conference, ISOCC 2020
Country/Territory	Korea, Republic of
City	Yeosu
Period	20/10/21 → 20/10/24

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

All Science Journal Classification (ASJC) codes

Energy Engineering and Power Technology
Electrical and Electronic Engineering
Instrumentation
Artificial Intelligence
Hardware and Architecture

Access to Document

10.1109/ISOCC50952.2020.9333101

Cite this

Cha, J., Kim, J., & Kim, S. (2020). Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface. In Proceedings - International SoC Design Conference, ISOCC 2020 (pp. 342-343). Article 9333101 (Proceedings - International SoC Design Conference, ISOCC 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISOCC50952.2020.9333101

@inproceedings{25438b9be49942e383bf1b87948ea53d,

title = "Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface",

abstract = "We propose a novel type of near-infrared (NIR) based sensory system for the detection of skin deformation induced by facial expressions. The proposed system utilizes the diffusion property which was called spatially resolved diffuse reflectance of NIR light in human skin as clues of detecting skin deformations. The sensor was mainly composed of NIR laser diode and a camera as a light source and receiver. To refine the information from captured IR raw images, we exploited principal component analysis based preprocessing procedure. By producing sensor data collecting experiment on several participants, we've verified the facial deformation tracking performance of the proposed sensory system.",

keywords = "AR and VR (Augmented Virtual Reality), HMD (Head Mounted Display), NIR (Near Infrared), SRDR (Spatially Resolved Diffuse Reflectance), UI (User Interface)",

author = "Jaekwang Cha and Jinhyuk Kim and Shiho Kim",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 17th International System-on-Chip Design Conference, ISOCC 2020 ; Conference date: 21-10-2020 Through 24-10-2020",

year = "2020",

month = oct,

day = "21",

doi = "10.1109/ISOCC50952.2020.9333101",

language = "English",

series = "Proceedings - International SoC Design Conference, ISOCC 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "342--343",

booktitle = "Proceedings - International SoC Design Conference, ISOCC 2020",

address = "United States",

}

Cha, J, Kim, J & Kim, S 2020, Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface. in Proceedings - International SoC Design Conference, ISOCC 2020., 9333101, Proceedings - International SoC Design Conference, ISOCC 2020, Institute of Electrical and Electronics Engineers Inc., pp. 342-343, 17th International System-on-Chip Design Conference, ISOCC 2020, Yeosu, Korea, Republic of, 20/10/21. https://doi.org/10.1109/ISOCC50952.2020.9333101

Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface. / Cha, Jaekwang; Kim, Jinhyuk; Kim, Shiho.
Proceedings - International SoC Design Conference, ISOCC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 342-343 9333101 (Proceedings - International SoC Design Conference, ISOCC 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface

AU - Cha, Jaekwang

AU - Kim, Jinhyuk

AU - Kim, Shiho

PY - 2020/10/21

Y1 - 2020/10/21

N2 - We propose a novel type of near-infrared (NIR) based sensory system for the detection of skin deformation induced by facial expressions. The proposed system utilizes the diffusion property which was called spatially resolved diffuse reflectance of NIR light in human skin as clues of detecting skin deformations. The sensor was mainly composed of NIR laser diode and a camera as a light source and receiver. To refine the information from captured IR raw images, we exploited principal component analysis based preprocessing procedure. By producing sensor data collecting experiment on several participants, we've verified the facial deformation tracking performance of the proposed sensory system.

AB - We propose a novel type of near-infrared (NIR) based sensory system for the detection of skin deformation induced by facial expressions. The proposed system utilizes the diffusion property which was called spatially resolved diffuse reflectance of NIR light in human skin as clues of detecting skin deformations. The sensor was mainly composed of NIR laser diode and a camera as a light source and receiver. To refine the information from captured IR raw images, we exploited principal component analysis based preprocessing procedure. By producing sensor data collecting experiment on several participants, we've verified the facial deformation tracking performance of the proposed sensory system.

KW - AR and VR (Augmented Virtual Reality)

KW - HMD (Head Mounted Display)

KW - NIR (Near Infrared)

KW - SRDR (Spatially Resolved Diffuse Reflectance)

KW - UI (User Interface)

UR - http://www.scopus.com/inward/record.url?scp=85100752872&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85100752872&partnerID=8YFLogxK

U2 - 10.1109/ISOCC50952.2020.9333101

DO - 10.1109/ISOCC50952.2020.9333101

M3 - Conference contribution

AN - SCOPUS:85100752872

T3 - Proceedings - International SoC Design Conference, ISOCC 2020

SP - 342

EP - 343

BT - Proceedings - International SoC Design Conference, ISOCC 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 17th International System-on-Chip Design Conference, ISOCC 2020

Y2 - 21 October 2020 through 24 October 2020

ER -

Skin Deformation Deteciton Sensory System for AR Headset Hands-free Interface

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this