Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies

Saswat Mishra; Yun Soung Kim; Jittrapol Intarasirisawat; Young Tae Kwon; Yongkuk Lee; Musa Mahmood; Hyo Ryoung Lim; Robert Herbert; Ki Jun Yu; Chee Siang Ang; Woon Hong Yeo

doi:10.1126/sciadv.aay1729

Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies

Saswat Mishra, Yun Soung Kim, Jittrapol Intarasirisawat, Young Tae Kwon, Yongkuk Lee, Musa Mahmood, Hyo Ryoung Lim, Robert Herbert, Ki Jun Yu, Chee Siang Ang, Woon Hong Yeo

Department of Electrical and Electronic Engineering

Research output: Contribution to journal › Article › peer-review

73 Citations (Scopus)

Abstract

Recent advancements in electronic packaging and image processing techniques have opened the possibility for optics-based portable eye tracking approaches, but technical and safety hurdles limit safe implementation toward wearable applications. Here, we introduce a fully wearable, wireless soft electronic system that offers a portable, highly sensitive tracking of eye movements (vergence) via the combination of skin-conformal sensors and a virtual reality system. Advancement of material processing and printing technologies based on aerosol jet printing enables reliable manufacturing of skin-like sensors, while the flexible hybrid circuit based on elastomer and chip integration allows comfortable integration with a user's head. Analytical and computational study of a data classification algorithm provides a highly accurate tool for real-time detection and classification of ocular motions. In vivo demonstration with 14 human subjects captures the potential of the wearable electronics as a portable therapy system, whose minimized form factor facilitates seamless interplay with traditional wearable hardware.

Original language	English
Article number	eaay1729
Journal	Science Advances
Volume	6
Issue number	11
DOIs	https://doi.org/10.1126/sciadv.aay1729
Publication status	Published - 2020

Bibliographical note

Funding Information:
We thank the support from the Institute for Electronics and Nanotechnology, a member of the National Nanotechnology Coordinated Infrastructure, which is supported by the NSF (grant ECCS-1542174). W.-H.Y. acknowledges funding support from the NextFlex funded by the Department of Defense; the Georgia Research Alliance based in Atlanta, GA; and the Nano-Material Technology Development Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT, and Future Planning (2016M3A7B4900044). K.J.Y. acknowledges support from the National Research Foundation of Korea (Grant Nos. NRF-2018M3A7B4071109 and NRF-2019R1A2C2086085) and Yonsei-KIST Convergence Research Program.

Publisher Copyright:
Copyright © 2020 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC).

All Science Journal Classification (ASJC) codes

General

Access to Document

10.1126/sciadv.aay1729

Cite this

@article{8593bae89fcb4b2281bd01e03f8de2cc,

title = "Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies",

abstract = "Recent advancements in electronic packaging and image processing techniques have opened the possibility for optics-based portable eye tracking approaches, but technical and safety hurdles limit safe implementation toward wearable applications. Here, we introduce a fully wearable, wireless soft electronic system that offers a portable, highly sensitive tracking of eye movements (vergence) via the combination of skin-conformal sensors and a virtual reality system. Advancement of material processing and printing technologies based on aerosol jet printing enables reliable manufacturing of skin-like sensors, while the flexible hybrid circuit based on elastomer and chip integration allows comfortable integration with a user's head. Analytical and computational study of a data classification algorithm provides a highly accurate tool for real-time detection and classification of ocular motions. In vivo demonstration with 14 human subjects captures the potential of the wearable electronics as a portable therapy system, whose minimized form factor facilitates seamless interplay with traditional wearable hardware.",

author = "Saswat Mishra and Kim, {Yun Soung} and Jittrapol Intarasirisawat and Kwon, {Young Tae} and Yongkuk Lee and Musa Mahmood and Lim, {Hyo Ryoung} and Robert Herbert and Yu, {Ki Jun} and Ang, {Chee Siang} and Yeo, {Woon Hong}",

note = "Funding Information: We thank the support from the Institute for Electronics and Nanotechnology, a member of the National Nanotechnology Coordinated Infrastructure, which is supported by the NSF (grant ECCS-1542174). W.-H.Y. acknowledges funding support from the NextFlex funded by the Department of Defense; the Georgia Research Alliance based in Atlanta, GA; and the Nano-Material Technology Development Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT, and Future Planning (2016M3A7B4900044). K.J.Y. acknowledges support from the National Research Foundation of Korea (Grant Nos. NRF-2018M3A7B4071109 and NRF-2019R1A2C2086085) and Yonsei-KIST Convergence Research Program. Publisher Copyright: Copyright {\textcopyright} 2020 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC).",

year = "2020",

doi = "10.1126/sciadv.aay1729",

language = "English",

volume = "6",

journal = "Science advances",

issn = "2375-2548",

publisher = "American Association for the Advancement of Science",

number = "11",

}

TY - JOUR

T1 - Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies

AU - Mishra, Saswat

AU - Kim, Yun Soung

AU - Intarasirisawat, Jittrapol

AU - Kwon, Young Tae

AU - Lee, Yongkuk

AU - Mahmood, Musa

AU - Lim, Hyo Ryoung

AU - Herbert, Robert

AU - Yu, Ki Jun

AU - Ang, Chee Siang

AU - Yeo, Woon Hong

N1 - Funding Information: We thank the support from the Institute for Electronics and Nanotechnology, a member of the National Nanotechnology Coordinated Infrastructure, which is supported by the NSF (grant ECCS-1542174). W.-H.Y. acknowledges funding support from the NextFlex funded by the Department of Defense; the Georgia Research Alliance based in Atlanta, GA; and the Nano-Material Technology Development Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT, and Future Planning (2016M3A7B4900044). K.J.Y. acknowledges support from the National Research Foundation of Korea (Grant Nos. NRF-2018M3A7B4071109 and NRF-2019R1A2C2086085) and Yonsei-KIST Convergence Research Program. Publisher Copyright: Copyright © 2020 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC).

PY - 2020

Y1 - 2020

N2 - Recent advancements in electronic packaging and image processing techniques have opened the possibility for optics-based portable eye tracking approaches, but technical and safety hurdles limit safe implementation toward wearable applications. Here, we introduce a fully wearable, wireless soft electronic system that offers a portable, highly sensitive tracking of eye movements (vergence) via the combination of skin-conformal sensors and a virtual reality system. Advancement of material processing and printing technologies based on aerosol jet printing enables reliable manufacturing of skin-like sensors, while the flexible hybrid circuit based on elastomer and chip integration allows comfortable integration with a user's head. Analytical and computational study of a data classification algorithm provides a highly accurate tool for real-time detection and classification of ocular motions. In vivo demonstration with 14 human subjects captures the potential of the wearable electronics as a portable therapy system, whose minimized form factor facilitates seamless interplay with traditional wearable hardware.

AB - Recent advancements in electronic packaging and image processing techniques have opened the possibility for optics-based portable eye tracking approaches, but technical and safety hurdles limit safe implementation toward wearable applications. Here, we introduce a fully wearable, wireless soft electronic system that offers a portable, highly sensitive tracking of eye movements (vergence) via the combination of skin-conformal sensors and a virtual reality system. Advancement of material processing and printing technologies based on aerosol jet printing enables reliable manufacturing of skin-like sensors, while the flexible hybrid circuit based on elastomer and chip integration allows comfortable integration with a user's head. Analytical and computational study of a data classification algorithm provides a highly accurate tool for real-time detection and classification of ocular motions. In vivo demonstration with 14 human subjects captures the potential of the wearable electronics as a portable therapy system, whose minimized form factor facilitates seamless interplay with traditional wearable hardware.

UR - http://www.scopus.com/inward/record.url?scp=85082092526&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85082092526&partnerID=8YFLogxK

U2 - 10.1126/sciadv.aay1729

DO - 10.1126/sciadv.aay1729

M3 - Article

C2 - 32201718

AN - SCOPUS:85082092526

SN - 2375-2548

VL - 6

JO - Science advances

JF - Science advances

IS - 11

M1 - eaay1729

ER -

Soft, wireless periocular wearable electronics for real-time detection of eye vergence in a virtual reality toward mobile eye therapies

Abstract

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this