Chang, X., Zhou, M., Wang, X. et al. (2 more authors) (2024) Informative relationship multi-task learning: exploring pairwise contribution across tasks’ sharing knowledge. Knowledge-Based Systems, 301. 112187. ISSN 0950-7051
Abstract
Multi-task learning is a machine learning paradigm, that aims to leverage useful domain information to help improve the generalization performance of all tasks. Learning the relationships of tasks helps to identify the latent tasks’ associations and access a better performance. However, most of the existing methods hardly pay attention to the determination of knowledge interaction among tasks and instead concentrate solely on certain aspects of task affinity. This compulsory similarity among all tasks leads to deficiencies in both task diversity and model robustness. To address this issue, we emphasize the task relationships within mutual information interaction. We propose a regularized framework from an informative perspective to quantify pairwise contributions during the knowledge-sharing stage, meanwhile utilizing an exclusive Lasso to identify the exclusive characteristics of tasks. An efficient optimization algorithm is developed to solve the proposed objective function. Detailed theoretical analyses and extensive experiments on both synthetic and real-world datasets are provided to demonstrate the effectiveness of our proposed method.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2024 The Author(s). Except as otherwise noted, this author-accepted version of a journal article published in Knowledge-Based Systems is made available via the University of Sheffield Research Publications and Copyright Policy under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ |
Keywords: | Multi-task Learning; Relationship Learning; Sparse Learning |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 03 Jul 2024 15:52 |
Last Modified: | 09 Aug 2024 15:33 |
Status: | Published |
Publisher: | Elsevier |
Refereed: | Yes |
Identification Number: | 10.1016/j.knosys.2024.112187 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:213770 |