Re-parameterizing your optimizers rather than architectures

Ding, X., Chen, H., Zhang, X. et al. (3 more authors) (2023) Re-parameterizing your optimizers rather than architectures. In: Proceedings of the Eleventh International Conference on Learning Representations (ICLR 2023). The Eleventh International Conference on Learning Representations (ICLR), 01-05 May 2023, Kigali Rwanda. OpenReview

Abstract

Metadata

Item Type: Proceedings Paper
Authors/Creators:
  • Ding, X.
  • Chen, H.
  • Zhang, X.
  • Huang, K.
  • Han, J.
  • Ding, G.
Copyright, Publisher and Additional Information:

© 2023 The Author(s).

Keywords: Deep Learning; Model Architecture; Optimizer; Re-parameterization
Dates:
  • Published (online): 1 February 2023
  • Accepted: 20 January 2023
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield)
Depositing User: Symplectic Sheffield
Date Deposited: 22 Feb 2023 17:06
Last Modified: 28 Sep 2023 15:14
Published Version: https://openreview.net/forum?id=B92TMCG_7rp
Status: Published
Publisher: OpenReview
Refereed: Yes
Related URLs:
Open Archives Initiative ID (OAI ID):

Download

Accepted Version


Under temporary embargo

Filename: 1626_re_parameterizing_your_optimiz-ICLR2023.pdf

Request a copy

file not available

Export

Statistics