Chen, R., Mihaylova, L. orcid.org/0000-0001-5856-2223, Zhu, H. et al. (1 more author) (2020) A deep learning framework for joint image restoration and recognition. Circuits, Systems and Signal Processing, 39 (3). pp. 1561-1580. ISSN 0278-081X
Abstract
Image restoration and recognition are important computer vision tasks representing an inherent part of autonomous systems. These two tasks are often implemented in a sequential manner, in which the restoration process is followed by a recognition. In contrast, this paper proposes a joint framework that simultaneously performs both tasks within a shared deep neural network architecture. This joint framework integrates the restoration and recognition tasks by incorporating: i) common layers, ii) restoration layers and iii) classification layers. The total loss function combines the restoration and classification losses. The proposed joint framework, based on capsules, provides an efficient solution that can cope with challenges due to noise, image rotations and occlusions. The developed framework has been validated and evaluated on a public vehicle logo dataset under various degradation conditions, including Gaussian noise, rotation and occlusion. The results show that the joint framework improves the accuracy compared with the single task networks.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2019 The Author(s) 2019. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
Keywords: | Capsule networks; Image restoration; Image recognition; Deep neural networks |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Automatic Control and Systems Engineering (Sheffield) |
Funding Information: | Funder Grant number European Commission - Horizon 2020 688082 |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 23 Jul 2019 10:02 |
Last Modified: | 24 Feb 2020 09:26 |
Status: | Published |
Publisher: | Springer |
Refereed: | Yes |
Identification Number: | 10.1007/s00034-019-01222-x |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:148223 |
Download
Filename: Chen2019_Article_ADeepLearningFrameworkForJoint.pdf
Licence: CC-BY 4.0