Ultrathin crystalline-silicon-based strain gauges with deep learning algorithms for silent speech interfaces

Taemin Kim, Yejee Shin, Kyowon Kang, Kiho Kim, Gwanho Kim, Yunsu Byeon, Hwayeon Kim, Yuyan Gao, Jeong Ryong Lee, Geonhui Son, Taeseong Kim, Yohan Jun, Jihyun Kim, Jinyoung Lee, Seyun Um, Yoohwan Kwon, Byung Gwan Son, Myeongki Cho, Mingyu Sang, Jongwoon ShinKyubeen Kim, Jungmin Suh, Heekyeong Choi, Seokjun Hong, Huanyu Cheng, Hong Goo Kang, Dosik Hwang, Ki Jun Yu

Research output: Contribution to journalArticlepeer-review

27 Citations (Scopus)

Abstract

A wearable silent speech interface (SSI) is a promising platform that enables verbal communication without vocalization. The most widely studied methodology for SSI focuses on surface electromyography (sEMG). However, sEMG suffers from low scalability because of signal quality-related issues, including signal-to-noise ratio and interelectrode interference. Hence, here, we present a novel SSI by utilizing crystalline-silicon-based strain sensors combined with a 3D convolutional deep learning algorithm. Two perpendicularly placed strain gauges with minimized cell dimension (<0.1 mm2) could effectively capture the biaxial strain information with high reliability. We attached four strain sensors near the subject’s mouths and collected strain data of unprecedently large wordsets (100 words), which our SSI can classify at a high accuracy rate (87.53%). Several analysis methods were demonstrated to verify the system’s reliability, as well as the performance comparison with another SSI using sEMG electrodes with the same dimension, which exhibited a relatively low accuracy rate (42.60%).

Original languageEnglish
Article number5815
JournalNature communications
Volume13
Issue number1
DOIs
Publication statusPublished - 2022 Dec

Bibliographical note

Publisher Copyright:
© 2022, The Author(s).

All Science Journal Classification (ASJC) codes

  • General Chemistry
  • General Biochemistry,Genetics and Molecular Biology
  • General Physics and Astronomy

Fingerprint

Dive into the research topics of 'Ultrathin crystalline-silicon-based strain gauges with deep learning algorithms for silent speech interfaces'. Together they form a unique fingerprint.

Cite this