LARR: A Localization-Assisted Method to Conceal Latency-Induced Position Errors in MR Remote Rendering

Hong Lin Zeng, Zheng Ting Huang, Chih Wei Huang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The future of social interaction lies in the Metaverse, where mixed reality (MR) plays a key role. With the growth of the Metaverse, there is a growing demand for volumetric videos in the media industry. However, rendering complex volumetric content on mobile devices with limited computing power presents a challenge. To address this, we propose a localization-assisted remote rendering (LARR) architecture for MR applications, which can effectively conceal delay-induced position error and display streamed objects accurately. The LARR architecture uses dedicated object streaming cameras (OSC) at the server for each 3D object to enable real-time position updates. In addition, stream data optimization is used to minimize unnecessary data transfer. The LARR approach reduces streaming data by 81% and 46% compared to non-optimized and existing MR streaming architectures in real-world experiments.

Original languageEnglish
Title of host publication2023 IEEE International Conference on Communications Workshops
Subtitle of host publicationSustainable Communications for Renaissance, ICC Workshops 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1439-1444
Number of pages6
ISBN (Electronic)9798350333077
DOIs
StatePublished - 2023
Event2023 IEEE International Conference on Communications Workshops, ICC Workshops 2023 - Rome, Italy
Duration: 28 May 20231 Jun 2023

Publication series

Name2023 IEEE International Conference on Communications Workshops: Sustainable Communications for Renaissance, ICC Workshops 2023

Conference

Conference2023 IEEE International Conference on Communications Workshops, ICC Workshops 2023
Country/TerritoryItaly
CityRome
Period28/05/231/06/23

Keywords

  • delay compensation
  • low-latency communication
  • Mixed Reality
  • remote rendering

Fingerprint

Dive into the research topics of 'LARR: A Localization-Assisted Method to Conceal Latency-Induced Position Errors in MR Remote Rendering'. Together they form a unique fingerprint.

Cite this