When tokenizers fail: Byte-level chunking for zero-shot transfer to low-resource languages

This is the latest version of this eprint.

Kumar, S., Yamaguchi, A. orcid.org/0000-0001-8327-7598 and Aletras, N. (2026) When tokenizers fail: Byte-level chunking for zero-shot transfer to low-resource languages. In: Lee, H.Y., Dev, S., Li, J.J, and Elliott, D., (eds.) Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing. Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, 24-29 Oct 2026, Budapest, Hungary. Association for Computational Linguistics, pp. 48638-48651. ISBN: 9798891764590.

Abstract

Metadata

Item Type: Proceedings Paper
Authors/Creators:
Editors:
  • Lee, H.Y.
  • Dev, S.
  • Li, J.J,
  • Elliott, D.
Copyright, Publisher and Additional Information:

© 2026 Association for Computational Linguistics (ACL). Licensed on a Creative Commons Attribution 4.0 International License. (https://creativecommons.org/licenses/by/4.0/)

Dates:
  • Published: 24 October 2026
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield)
Date Deposited: 11 Nov 2026 15:13
Last Modified: 11 Nov 2026 15:39
Status: Published
Publisher: Association for Computational Linguistics
Refereed: Yes
Identification Number: 10.18653/2026.emnlp-main.2139
Related URLs:
Open Archives Initiative ID (OAI ID):

Available Versions of this Item

Export

Statistics