Eye detection in a facial image under pose variation based on multi-scale iris shape feature

Hyunjun Kim, Jaeik Jo, Kar Ann Toh, Jaihie Kim

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)


The accurate location of eyes in a facial image is important to many human facial recognition-related applications, and has attracted considerable research interest in computer vision. However, most prevalent methods are based on the frontal pose of the face, where applying them to non-frontal poses can yield erroneous results. In this paper, we propose an eye detection method that can locate the eyes in facial images captured at various head poses. Our proposed method consists of two stages: eye candidate detection and eye candidate verification. In eye candidate detection, eye candidates are obtained by using multi-scale iris shape features and integral image. The size of the iris in face images varies as the head pose changes, and the proposed multi-scale iris shape feature method can detect the eyes in such cases. Since it utilizes the integral image, its computational cost is relatively low. The extracted eye candidates are then verified in the eye candidate verification stage using a support vector machine (SVM) based on the feature-level fusion of a histogram of oriented gradients (HOG) and cell mean intensity features. We tested the performance of the proposed method using the Chinese Academy of Sciences’ Pose, Expression, Accessories, and Lighting (CAS-PEAL) database and the Pointing'04 database. The results confirmed the superiority of our method over the conventional Haar-like detector and two hybrid eye detectors under relatively extreme head pose variations.

Original languageEnglish
Pages (from-to)147-164
Number of pages18
JournalImage and Vision Computing
Publication statusPublished - 2017 Jan 1

Bibliographical note

Publisher Copyright:
© 2016 Elsevier B.V.

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Eye detection in a facial image under pose variation based on multi-scale iris shape feature'. Together they form a unique fingerprint.

Cite this