Liu, T., Wang, X., Huang, H. et al. (1 more author) (2023) Weak regression enhanced lifelong learning for improved performance and reduced training data. In: CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 32nd ACM International Conference on Information and Knowledge Management (CIKM 2023), 21-25 Oct 2023, Birmingham, United Kingdom. Association for Computing Machinery , pp. 1587-1596. ISBN 979-8-4007-0124-5
Abstract
As an emerging learning paradigm, lifelong learning intends to solve multiple consecutive tasks over long-time scales upon previously accumulated knowledge. When facing with a new task, existing lifelong learning approaches need first gather sufficient training data to identify task relationships before knowledge transfer can succeed. However, annotating large number of training data persistently for every coming task is time-consuming, which can be prohibitive for real-world lifelong regression problems. To reduce this burden, we propose to incorporate weak regression into lifelong learning so as to enhance training data and improve predictive performance. Specifically, the weak prediction is first produced by single-task predictor, which is encoded as feature vectors that contain essential prior output information. This weak regression is further linked with task model via coupled dictionary learning. The integration of weak regression and task model can facilitate both cross-task and inter-task knowledge transfer, thus improving the overall performance. More critically, the weak regression can backup the task model especially when there is insufficient training data to construct an accurate model. Three real-world datasets are used to evaluate the effectiveness of our proposed method. Results show that our method outperforms existing lifelong models and single-task models even if training data is minimal.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2023 Association for Computing Machinery. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, https://doi.org/10.1145/3583780.3615108. |
Keywords: | lifelong learning; weak regression; coupled dictionary learning; knowledge transfer |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Funding Information: | Funder Grant number INNOVATE UK TS/V002953/1 |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 23 Aug 2023 14:57 |
Last Modified: | 01 Nov 2023 15:08 |
Status: | Published |
Publisher: | Association for Computing Machinery |
Refereed: | Yes |
Identification Number: | 10.1145/3583780.3615108 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:202231 |