Real-time hand ownership decision in egocentric view using kinematic approach

Soon Hong Hwang, Sungha Woo, Jong Min Lim, Byung Kwon Min

Research output: Contribution to journalArticlepeer-review

Abstract

With the increasing popularity of egocentric vision applications, studies have focused on hand identification or ownership decision, which is the process of disambiguating the hands of the camera wearer and other individuals’ hands. However, hand ownership decisions for egocentric applications such as manipulating a human–computer interface in the first-person view and operating a machine on the manufacturing floor may require highly personalized training data. Therefore, this paper proposes a hand ownership decision method that utilizes depth images filtered with kinematic constraints of the wearer to separate wearers’ hands from others’ hands in the egocentric view. In this approach, when a wearer dons an egocentric camera system on their chest and kinematic information of the wearer is known, the hands are detected and arm pose is estimated using the human arm kinematic model. The estimated arm pose is then evaluated with kinematic constraints that describe the range of motion of the wearer’s arm. For enhancing the performance in consecutive frames, a smoothing filter was adopted for giving a reward or penalty to the hand in each frame. The pose estimation method is verified using a laser tracker system. The experimental results show that the proposed method can distinguish the wearer’s hands from others’ hands in real-time. Furthermore, an application of operating a machine is described to demonstrate the effectiveness of the proposed method.

Original languageEnglish
Pages (from-to)2759-2769
Number of pages11
JournalJournal of Ambient Intelligence and Humanized Computing
Volume14
Issue number3
DOIs
Publication statusPublished - 2023 Mar

Bibliographical note

Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Real-time hand ownership decision in egocentric view using kinematic approach'. Together they form a unique fingerprint.

Cite this