Guan, Hao and Smith, William Alfred Peter orcid.org/0000-0002-6047-0413 (2017) Structure-from-motion in Spherical Video using the von Mises-Fisher Distribution. IEEE Transactions on Image Processing. 7707455. pp. 711-723. ISSN 1057-7149
Abstract
In this paper, we present a complete pipeline for computing structure-from-motion from the sequences of spherical images. We revisit problems from multiview geometry in the context of spherical images. In particular, we propose methods suited to spherical camera geometry for the spherical-n-point problem (estimating camera pose for a spherical image) and calibrated spherical reconstruction (estimating the position of a 3-D point from multiple spherical images). We introduce a new probabilistic interpretation of spherical structure-from-motion which uses the von Mises-Fisher distribution to model noise in spherical feature point positions. This model provides an alternate objective function that we use in bundle adjustment. We evaluate our methods quantitatively and qualitatively on both synthetic and real world data and show that our methods developed for spherical images outperform straightforward adaptations of methods developed for perspective images. As an application of our method, we use the structure-from-motion output to stabilise the viewing direction in fully spherical video.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works |
Keywords: | 360 video,Structure-from-motion,spherical image,view stabilisation |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 08 Dec 2016 15:42 |
Last Modified: | 16 Oct 2024 13:27 |
Published Version: | https://doi.org/10.1109/TIP.2016.2621662 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1109/TIP.2016.2621662 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:109220 |