3D model reconstruction from a single image with IMU data

Tzu Fei Chen, Huan Chang, Fuan Tsai

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This research developed a method for reconstructing 3D scenes from a single photograph with depth map and inertial measurement unit (IMU). The proposed method uses IMU to provide the relative attitudes of Exterior Orientation Parameters (EOP) and assumes the camera position is the origin. Depth map provides the relative distance from feature points to the camera center. Therefore, collinearity condition equations can be constructed to determine 3D positions of feature points from a single image. In this study, there are four steps for 3D scene reconstruction from a single image: (1) camera and boresight calibration; (2) depth map generation; (3) feature points calculation; (4) 3D scene model reconstruction. The proposed method begins with angles calibration between camera boresight and IMU system. Broesight angles can be predicted using the result of image back projection and simultaneously recorded orientation data from the IMU. Using the relative distance provided from the depth map, coordinates of the extracted feature points are determined from collinearity condition equations. Finally, the feature points are used to reconstruct 3D models. Textures are then applied to the constructed models for visualization. In order to evaluate the quality of reconstructed model, this research simulates the effects caused by different errors to estimate the accuracy of the models.

Original languageEnglish
Title of host publication32nd Asian Conference on Remote Sensing 2011, ACRS 2011
Pages1939-1944
Number of pages6
StatePublished - 2011
Event32nd Asian Conference on Remote Sensing 2011, ACRS 2011 - Tapei, Taiwan
Duration: 3 Oct 20117 Oct 2011

Publication series

Name32nd Asian Conference on Remote Sensing 2011, ACRS 2011
Volume3

Conference

Conference32nd Asian Conference on Remote Sensing 2011, ACRS 2011
Country/TerritoryTaiwan
CityTapei
Period3/10/117/10/11

Keywords

  • Accuracy assessment
  • Depth map
  • Inertial measurement unit (IMU)
  • Single image reconstruction

Fingerprint

Dive into the research topics of '3D model reconstruction from a single image with IMU data'. Together they form a unique fingerprint.

Cite this