Ye, Fei and Bors, Adrian Gheorghe orcid.org/0000-0001-7838-0021 (2020) Lifelong learning of interpretable image representations. In: Proc. Int. Conf. on Image Processing, Theory, Tools and Applications (IPTA). IEEE , Paris, France
Abstract
Existing machine learning systems are trained to adapt to a single database and their ability to acquire additional information is limited. Catastrophic forgetting occurs in all deep learning systems when attempting to train them with additional databases. The information learnt previously is forgotten and no longer recognized when such a learning systems is trained using a new database. In this paper, we develop a new image generation approach defined under the lifelong learning framework which prevents forgetting. We employ the mutual information maximization between the latent variable space and the outputs of the generator network in order to learn interpretable representations, when learning using the data from a series of databases sequentially. We also provide the theoretical framework for the generative replay mechanism, under the lifelong learning setting. We perform a series of experiments showing that the proposed approach is able to learn a set of disjoint data distributions in a sequential manner while also capturing meaningful data representations across domains
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 30 Nov 2020 12:20 |
Last Modified: | 18 Dec 2024 00:39 |
Published Version: | https://doi.org/10.1109/IPTA50016.2020.9286663 |
Status: | Published |
Publisher: | IEEE |
Identification Number: | 10.1109/IPTA50016.2020.9286663 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:168547 |
Download
Filename: IPTA2020b.pdf
Description: Lifelong learning of interpretable image representations