Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors

Ji Yong Kwon, Moon Gi Kang

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)


A near-infrared (NIR) band provides information invisible to human eyes for discriminating and recognizing objects more clearly under low lighting conditions. To capture color and NIR images simultaneously, a multispectral filter array (MSFA) sensor is used. However, because lenses have different refractive indices for different wavelengths, lenses may fail to focus all rays to the same convergence. This is the reason an out-of-focus problem occurs and images are blurred. In this paper, a demosaicking algorithm that considers the out-of-focus problem is proposed. This algorithm is used by the MSFA of a red-green-blue-NIR image sensor to obtain color and NIR images. After the energies of the multispectral (MS) channels in the MSFA image are balanced to minimize aliasing, that image is filtered by the estimated low-pass kernel to generate a panchromatic (PAN) image. When an image is acquired, the out-of-focus problem and the formation process of the PAN image are modeled. The desired MS image is estimated by solving the least squares approach of the difference between the PAN and MS images based on the models. The experimental results show that the proposed algorithm performs well in estimating high-quality MS images and reduces the out-of-focus problem.

Original languageEnglish
Article number023010
JournalJournal of Electronic Imaging
Issue number2
Publication statusPublished - 2016 Mar 1

Bibliographical note

Publisher Copyright:
© 2016 SPIE and IS&T.

All Science Journal Classification (ASJC) codes

  • Atomic and Molecular Physics, and Optics
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'Multispectral demosaicking considering out-of-focus problem for red-green-blue-near-infrared image sensors'. Together they form a unique fingerprint.

Cite this