Multi-frame super-resolution utilizing spatially adaptive regularization for ToF camera

Haegeun Lee, Jonghyun Kim, Jaeduk Han, Moon G.I. Kang

Research output: Contribution to journalConference articlepeer-review


Recently, 3D time-of-flight cameras have been developed. The development enables utilization of depth images in various fields. However, acquired depth images are corrupted by noise during the image acquisition process and have relatively lower resolution than RGB images due to the limitation of ToF cameras. In this paper, a multi-frame super-resolution reconstruction algorithm is proposed for ToF depth images to overcome such limits. The purpose of the multi-frame super-resolution reconstruction is to reconstruct a high-resolution image from observed multiple low-resolution images through the sequential process of subpixel estimation and restoration. A conventional regularized super-resolution reconstruction algorithm which takes Tikhonov regularization has a major drawback of over-smoothing around edges. To overcome the disadvantage, the spatially adaptive regularization is suggested for preservation of edges. Experimental results show that the image reconstructed by the proposed super-resolution reconstruction algorithm contains significantly higher resolution with less amount of noise and sharper edges than the observed data.

Original languageEnglish
Article numberIPAS-275
JournalIS and T International Symposium on Electronic Imaging Science and Technology
Issue number11
Publication statusPublished - 2019 Jan 13
Event17th Image Processing: Algorithms and Systems Conference, IPAS 2019 - Burlingame, United States
Duration: 2019 Jan 132019 Jan 17

Bibliographical note

Publisher Copyright:
© 2019, Society for Imaging Science and Technology.

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Human-Computer Interaction
  • Software
  • Electrical and Electronic Engineering
  • Atomic and Molecular Physics, and Optics


Dive into the research topics of 'Multi-frame super-resolution utilizing spatially adaptive regularization for ToF camera'. Together they form a unique fingerprint.

Cite this