Fusion of visual and infrared images for face recognition

Sang Ki Kim, Hyobin Lee, Sunjin Yu, Sangyoun Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


This paper proposes a robust face recognition method by fusing images acquired from visual and infrared (IR) sensors. Although current 2D image face recognition systems have reached a certain level of maturity, the performance of these systems has been limited by external conditions such as pose, expression and illumination. To alleviate some of these problems, infrared sensor based methods have been suggested. These methods showed very good performance when used in illumination variation environments. However, one of the main drawbacks of using IR sensors for recognition is that they are very sensitive to ambient temperatures. To solve this problem, we suggest a face recognition method that fuses both visual and IR techniques. We developed a visual and IR face image database with photographs taken under a wide range of imaging conditions. With this database, we are able to produce full combinations of comparative experiments in the field of face recognition. Our experiments showed that when using both modalities, results are far better in terms of recognition performance than when using only one modality. The overall average performance was observed to have improved under all imaging conditions.

Original languageEnglish
Title of host publication2006 SICE-ICASE International Joint Conference
Number of pages5
Publication statusPublished - 2006
Event2006 SICE-ICASE International Joint Conference - Busan, Korea, Republic of
Duration: 2006 Oct 182006 Oct 21

Publication series

Name2006 SICE-ICASE International Joint Conference


Other2006 SICE-ICASE International Joint Conference
Country/TerritoryKorea, Republic of

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Control and Systems Engineering
  • Electrical and Electronic Engineering


Dive into the research topics of 'Fusion of visual and infrared images for face recognition'. Together they form a unique fingerprint.

Cite this