Guo, P., Su, W., Zhang, X. orcid.org/0000-0002-1882-736X et al. (2 more authors) (2024) Modeling the non‑uniform retinal perception for viewport‑dependent streaming of immersive video. Multimedia Systems, 30. 237. ISSN 0942-4962
Abstract
Viewport-dependent streaming (VDS) of immersive video typically devises the attentive viewport (or FoV - Field of View) with high-quality compression but low-quality compressed content outside of it to reduce bandwidth. It, however, assumes uniform compression within the viewport, completely neglecting visual redundancy caused by non-uniform perception in central and peripheral vision areas when consuming the content using a head-mounted display (HMD). Our work models the unequal retinal perception within the instantaneous viewport and explores using it in the VDS system for non-uniform viewport compression to further save the data volume. To this end, we assess the just-noticeable-distortion moment of the rendered viewport frame by carefully adapting image quality-related compression factors like quantization stepsize q and/or spatial resolution s zone-by-zone to explicitly derive the imperceptible quality perception threshold with respect to the eccentric angle. Independent validations show that the visual perception of the immersive images with non-uniform FoV quality guided by our model is indistinguishable from that of images with default uniform FoV quality. Our model can be flexibly integrated with the tiling strategy in popular video codecs to facilitate non-uniform viewport compression in practical VDS systems for significant bandwidth reduction (e.g., about 40% reported in our experiments) at similar visual quality.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2024. This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature’s AM terms of use (https://www.springernature.com/gp/open-research/policies/accepted-manuscript-terms), but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s00530-024-01434-5. |
Keywords: | Quality perception threshold, Non-uniform visual sensation, Viewport-dependent streaming, VR quality assessment |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > SWJTU Joint School (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 25 Jul 2024 16:30 |
Last Modified: | 21 Oct 2024 14:21 |
Status: | Published |
Publisher: | Springer |
Identification Number: | 10.1007/s00530-024-01434-5 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:215115 |
Download
Filename: 2024MMSystems.pdf
