An efficient eye tracking using pomdp for robust human computer interaction

Ji Hye Rhee, Won Jun Sung, Mi Young Nam, Hyeran Byun, Phill Kyu Rhee

Research output: Chapter in Book/Report/Conference proceedingConference contribution


We propose an adaptive eye tracking system for robust humancomputer interaction under dynamically changing environments based on the partially observable Markov Decision Process (POMDP). In our system, realtime eye tracking optimization is tackled using a flexible world-context model based POMDP approach that requires less data and time in adaptation than those of hard world-context model approaches. The challenge is to divide the huge belief space into world-context models, and to search for optimal control parameters in the current world-context model with real-time constraints. The offline learning determines multiple world-context models based on imagequality analysis over the joint space of transition, observation, reward distributions, and an approximate world-context model is balanced with the online learning over a localized horizon. The online learning is formulated as a dynamic parameter control with incomplete information under real-time constraints, and is solved by the real-time Q-learning approach. Extensive experiments conducted using realistic videos have provided us with very encouraging results.

Original languageEnglish
Title of host publicationComputer Vision Systems - 10th International Conference, ICVS 2015, Proceedings
EditorsAntonios Gasteratos, Lazaros Nalpantidis, Volker Kruger, Jan-Olof Eklundh
PublisherSpringer Verlag
Number of pages9
ISBN (Print)9783319209036
Publication statusPublished - 2015
Event10th International Conference on Computer Vision Systems, ICVS 2015 - Copenhagen, Denmark
Duration: 2015 Jul 62015 Jul 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other10th International Conference on Computer Vision Systems, ICVS 2015

Bibliographical note

Publisher Copyright:
© Springer International Publishing Switzerland 2015.

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'An efficient eye tracking using pomdp for robust human computer interaction'. Together they form a unique fingerprint.

Cite this