Video narrative authoring with motion inpainting

Timothy K. Shih, Joseph C. Tsai, Kuan Ching Li

研究成果: 書貢獻/報告類型會議論文篇章同行評審

3 引文 斯高帕斯(Scopus)

摘要

Storytelling and narrative creation are recent interests in the areas of interactive media designs. Instead of using virtual reality-based 3-D models, we propose a system which uses video technologies to generate video story from existing avatars and videos, with moderate avatar control technologies. The user only needs to involve in two steps: (1) select a background video as video scene; and (2) pick an "object track" and set up its trajectory. In order to plan for a realistic narrative, several issues such as computing relative sizes of avatars, object pasting, and video scene generating are considered. We use an algorithm for aligning motion of object tracks in order to make object movement smoother. For producing a video static scene including calibrating all layers, we maintain a motion map for each video frame and use the maps as guidance when removing objects in video and combining all frames back to a video scene. To generate a dynamic background, we proposed motion inpainting to create more dynamic textures and insert the new patch into inpainting area to generate a new dynamic background. An authoring tool equipped with special functions to integrate different motion tracks for the generation of video narratives is also presented in this paper.

原文???core.languages.en_GB???
主出版物標題MPVA'10 - Proceedings of the 2010 ACM Workshop on Multimodal Pervasive Video Analysis, Co-located with ACM Multimedia 2010
頁面11-16
頁數6
DOIs
出版狀態已出版 - 2010
事件1st ACM International Workshop on Multimodal Pervasive Video Analysis, MPVA 2010, Co-located with ACM Multimedia 2010 - Firenze, Italy
持續時間: 29 10月 201029 10月 2010

出版系列

名字MPVA'10 - Proceedings of the 2010 ACM Workshop on Multimodal Pervasive Video Analysis, Co-located with ACM Multimedia 2010

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???1st ACM International Workshop on Multimodal Pervasive Video Analysis, MPVA 2010, Co-located with ACM Multimedia 2010
國家/地區Italy
城市Firenze
期間29/10/1029/10/10

指紋

深入研究「Video narrative authoring with motion inpainting」主題。共同形成了獨特的指紋。

引用此