Video narrative authoring with motion inpainting

Timothy K. Shih, Joseph C. Tsai, Kuan Ching Li

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

Storytelling and narrative creation are recent interests in the areas of interactive media designs. Instead of using virtual reality-based 3-D models, we propose a system which uses video technologies to generate video story from existing avatars and videos, with moderate avatar control technologies. The user only needs to involve in two steps: (1) select a background video as video scene; and (2) pick an "object track" and set up its trajectory. In order to plan for a realistic narrative, several issues such as computing relative sizes of avatars, object pasting, and video scene generating are considered. We use an algorithm for aligning motion of object tracks in order to make object movement smoother. For producing a video static scene including calibrating all layers, we maintain a motion map for each video frame and use the maps as guidance when removing objects in video and combining all frames back to a video scene. To generate a dynamic background, we proposed motion inpainting to create more dynamic textures and insert the new patch into inpainting area to generate a new dynamic background. An authoring tool equipped with special functions to integrate different motion tracks for the generation of video narratives is also presented in this paper.

Original languageEnglish
Title of host publicationMPVA'10 - Proceedings of the 2010 ACM Workshop on Multimodal Pervasive Video Analysis, Co-located with ACM Multimedia 2010
Pages11-16
Number of pages6
DOIs
StatePublished - 2010
Event1st ACM International Workshop on Multimodal Pervasive Video Analysis, MPVA 2010, Co-located with ACM Multimedia 2010 - Firenze, Italy
Duration: 29 Oct 201029 Oct 2010

Publication series

NameMPVA'10 - Proceedings of the 2010 ACM Workshop on Multimodal Pervasive Video Analysis, Co-located with ACM Multimedia 2010

Conference

Conference1st ACM International Workshop on Multimodal Pervasive Video Analysis, MPVA 2010, Co-located with ACM Multimedia 2010
Country/TerritoryItaly
CityFirenze
Period29/10/1029/10/10

Keywords

  • Motion interpolation
  • Special effect
  • Video inpainting
  • Video narrative generation
  • Video planning

Fingerprint

Dive into the research topics of 'Video narrative authoring with motion inpainting'. Together they form a unique fingerprint.

Cite this