Smith, M.T., Alvarez, M.A. and Lawrence, N.D. orcid.org/0000-0001-9258-1030 (2021) Differentially private regression and classification with sparse Gaussian processes. Journal of Machine Learning Research, 22. 188. ISSN 1532-4435
Abstract
A continuing challenge for machine learning is providing methods to perform computation on data while ensuring the data remains private. In this paper we build on the provable privacy guarantees of differential privacy which has been combined with Gaussian processes through the previously published cloaking method, an approach that tackles the problem of providing privacy for the outputs of a training set. In this paper we solve several shortcomings of this method, starting with the problem of predictions in regions with low data density. We experiment with the use of inducing points to provide a sparse approximation and show that these can provide robust differential privacy in outlier areas and at higher dimensions. We then look at classification, and modify the Laplace approximation approach to provide differentially private predictions. We then combine this with the sparse approximation and demonstrate the capability to perform classification in high dimensions. We finally explore the issue of hyperparameter selection and develop a method for their private selection. This paper and associated libraries provide a robust toolkit for combining differential privacy and Gaussian processes in a practical manner.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2021 Michael Thomas Smith and Mauricio A. Álvarez and Neil D. Lawrence. License: CC-BY 4.0, see https://creativecommons.org/licenses/by/4.0/. |
Keywords: | Gaussian processes; differential privacy; classification; sparse Gaussian processes |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 19 Dec 2024 10:28 |
Last Modified: | 19 Dec 2024 10:28 |
Published Version: | https://www.jmlr.org/papers/v22/ |
Status: | Published |
Publisher: | Massachusetts Institute of Technology Press |
Refereed: | Yes |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:220987 |