Aldrian, Oswald and Smith, William Alfred Peter orcid.org/0000-0002-6047-0413 (2013) Inverse Rendering of Faces with a 3D Morphable Model. IEEE Transactions on Pattern Analysis and Machine Intelligence. 6313594. pp. 1080-1093. ISSN 0162-8828
Abstract
In this paper, we present a complete framework to inverse render faces with a 3D Morphable Model (3DMM). By decomposing the image formation process into geometric and photometric parts, we are able to state the problem as a multilinear system which can be solved accurately and efficiently. As we treat each contribution as independent, the objective function is convex in the parameters and a global solution is guaranteed. We start by recovering 3D shape using a novel algorithm which incorporates generalization error of the model obtained from empirical measurements. We then describe two methods to recover facial texture, diffuse lighting, specular reflectance, and camera properties from a single image. The methods make increasingly weak assumptions and can be solved in a linear fashion. We evaluate our findings on a publicly available database, where we are able to outperform an existing state-of-the-art algorithm. We demonstrate the usability of the recovered parameters in a recognition experiment conducted on the CMU-PIE database.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Keywords: | Cameras,Harmonic analysis ,Lighting,Rendering (Computer Graphics),Shape,Solid modeling,Vectors,Inverse Rendering,Face Shape,texture and illumination analysis |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Funding Information: | Funder Grant number EPSRC EP/F036949/1 |
Depositing User: | Pure (York) |
Date Deposited: | 21 Jul 2023 13:10 |
Last Modified: | 16 Oct 2024 12:16 |
Published Version: | https://doi.org/10.1109/TPAMI.2012.206 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1109/TPAMI.2012.206 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:201796 |