Aldrian, Oswald and Smith, William Alfred Peter orcid.org/0000-0002-6047-0413 (2013) Inverse Rendering of Faces with a 3D Morphable Model. IEEE Transactions on Pattern Analysis and Machine Intelligence. 6313594. pp. 1080-1093. ISSN 0162-8828
Abstract
In this paper, we present a complete framework to inverse render faces with a 3D Morphable Model (3DMM). By decomposing the image formation process into geometric and photometric parts, we are able to state the problem as a multilinear system which can be solved accurately and efficiently. As we treat each contribution as independent, the objective function is convex in the parameters and a global solution is guaranteed. We start by recovering 3D shape using a novel algorithm which incorporates generalization error of the model obtained from empirical measurements. We then describe two methods to recover facial texture, diffuse lighting, specular reflectance, and camera properties from a single image. The methods make increasingly weak assumptions and can be solved in a linear fashion. We evaluate our findings on a publicly available database, where we are able to outperform an existing state-of-the-art algorithm. We demonstrate the usability of the recovered parameters in a recognition experiment conducted on the CMU-PIE database.
Metadata
Authors/Creators: |
|
||||
---|---|---|---|---|---|
Keywords: | Cameras, Harmonic analysis , Lighting, Rendering (Computer Graphics), Shape, Solid modeling, Vectors, Inverse Rendering, Face Shape, texture and illumination analysis | ||||
Dates: |
|
||||
Institution: | The University of York | ||||
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) | ||||
Funding Information: |
|
||||
Depositing User: | Pure (York) | ||||
Date Deposited: | 21 Jul 2023 13:10 | ||||
Last Modified: | 06 Dec 2023 10:54 | ||||
Published Version: | https://doi.org/10.1109/TPAMI.2012.206 | ||||
Status: | Published | ||||
Refereed: | Yes | ||||
Identification Number: | https://doi.org/10.1109/TPAMI.2012.206 | ||||
Related URLs: |