Gu, Yajie and Pears, N. E. orcid.org/0000-0001-9513-5634 (2024) Parts-based Implicit 3D Face Modeling. In: Gu, Y. and N., Pears, (eds.) Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications:VISAPP 2024. VISIGRAPP . SciTePress , pp. 201-212.
Abstract
Previous 3D face analysis has focussed on 3D facial identity, expression and pose disentanglement. However, the independent control of different facial parts and the ability to learn explainable parts-based latent shape embeddings for implicit surfaces remain as open problems. We propose a method for 3D face modeling that learns a continuous parts-based deformation field that maps the various semantic parts of a subject's face to a template. By swapping affine-mapped facial features among different individuals from predefined regions we achieve significant parts-based training data augmentation. Moreover, by sequentially morphing the surface points of these parts, we learn corresponding latent representations, shape deformation fields, and the signed distance function of a template shape. This gives improved shape controllability and better interpretability of the face latent space, while retaining all of the known advantages of implicit surface modelling. Unlike previous works that generated new faces based on full-identity latent representations, our approach enables independent control of different facial parts, i.e. nose, mouth, eyes and also the remaining surface and yet generates new faces with high reconstruction quality. Evaluations demonstrate both facial expression and parts disentanglement, independent control of those facial parts, as well as state-of-the art facial parts reconstruction, when evaluated on FaceScape and Headspace datasets.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Editors: |
|
Copyright, Publisher and Additional Information: | This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy. |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 13 Feb 2024 09:00 |
Last Modified: | 16 Oct 2024 11:27 |
Published Version: | https://doi.org/10.5220/0012423200003660 |
Status: | Published |
Publisher: | SciTePress |
Series Name: | VISIGRAPP |
Identification Number: | 10.5220/0012423200003660 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:209116 |