Exemplar-based video inpainting without ghost shadow artifacts by maintaining temporal continuity

Timothy K. Shih, Nick C. Tang, Jenq Neng Hwang

Research output: Contribution to journalArticlepeer-review

66 Scopus citations

Abstract

Image inpainting or image completion is the technique that automatically restores/completes removed areas in an image. When dealing with a similar problem in video, not only should a robust tracking algorithm be used, but the temporal continuity among video frames also needs to be taken into account, especially when the video has camera motions such as zooming and tilting. In this paper, we extend an exemplar-based image inpainting algorithm by incorporating an improved patch matching strategy for video inpainting. In our proposed algorithm, different motion segments with different temporal continuity call for different candidate patches, which are used to inpaint holes after a selected video object is tracked and removed. The proposed new video inpainting algorithm produces very few "ghost shadows," which were produced by most image inpainting algorithms directly applied on video. Our experiments use different types of videos, including cartoon, video from games, and video from digital camera with different camera motions. Our demonstration at http://member.mine.tku.edu.tw/www/T-CSVT/web/shows the promising results.

Original languageEnglish
Article number4783052
Pages (from-to)347-360
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume19
Issue number3
DOIs
StatePublished - Mar 2009

Keywords

  • Digital inpainting
  • Image completion
  • Motion map segmentation
  • Object removal
  • Object tracking
  • Video inpainting
  • Video special effect

Fingerprint

Dive into the research topics of 'Exemplar-based video inpainting without ghost shadow artifacts by maintaining temporal continuity'. Together they form a unique fingerprint.

Cite this