Patch-guided facial image inpainting by shape propagation

Yue Ting Zhuang, Yu Shun Wang, Timothy K. Shih, Nick C. Tang

Research output: Contribution to journalArticlepeer-review

11 Scopus citations

Abstract

Images with human faces comprise an essential part in the imaging realm. Occlusion or damage in facial portions will bring a remarkable discomfort and information loss. We propose an algorithm that can repair occluded or damaged facial images automatically, named 'facial image inpainting'. Inpainting is a set of image processing methods to recover missing image portions. We extend the image inpainting methods by introducing facial domain knowledge. With the support of a face database, our approach propagates structural information, i.e., feature points and edge maps, from similar faces to the missing facial regions. Using the inferred structural information as guidance, an exemplar-based image inpainting algorithm is employed to copy patches in the same face from the source portion to the missing portion. This newly proposed concept of facial image inpainting outperforms the traditional inpainting methods by propagating the facial shapes from a face database, and avoids the problem of variations in imaging conditions from different images by inferring colors and textures from the same face image. Our system produces seamless faces that are hardly seen drawbacks.

Original languageEnglish
Pages (from-to)232-238
Number of pages7
JournalJournal of Zhejiang University: Science A
Volume10
Issue number2
DOIs
StatePublished - Feb 2009

Keywords

  • Face reconstruction
  • Feature point extraction
  • Image inpainting

Fingerprint

Dive into the research topics of 'Patch-guided facial image inpainting by shape propagation'. Together they form a unique fingerprint.

Cite this