Kuffner dos Anjos, R orcid.org/0000-0002-2616-7541, Walton, DR, Aksit, K et al. (4 more authors) (2022) Metameric Inpainting for Image Warping. IEEE Transactions on Visualization and Computer Graphics. pp. 1-12. ISSN 1077-2626
Abstract
Image-warping , a per-pixel deformation of one image into another, is an essential component in immersive visual experiences such as virtual reality or augmented reality. The primary issue with image warping is disocclusions, where occluded (and hence unknown) parts of the input image would be required to compose the output image. We introduce a new image warping method, Metameric image inpainting - an approach for hole-filling in real-time with foundations in human visual perception. Our method estimates image feature statistics of disoccluded regions from their neighbours. These statistics are inpainted and used to synthesise visuals in real-time that are less noticeable to study participants, particularly in peripheral vision. Our method offers speed improvements over the standard structured image inpainting methods while improving realism over colour-based inpainting such as push-pull. Hence, our work paves the way towards future applications such as depth image-based rendering, 6-DoF 360 rendering, and remote render-streaming.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | This item is protected by copyright. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Inpainting , warping , perception , real-time rendering |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 11 Jan 2023 12:00 |
Last Modified: | 14 Jan 2023 01:20 |
Status: | Published online |
Publisher: | IEEE |
Identification Number: | 10.1109/tvcg.2022.3216712 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:194571 |