White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Fine-grain morphological analyzer and part-of-speech tagger for Arabic text

Sawalha, M and Atwell, ES (2010) Fine-grain morphological analyzer and part-of-speech tagger for Arabic text. In: Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10). Language Resource and Evaluation Conference LREC 2010, 17 May 2010 - 23 May 2010, Valleta, Malta. European Language Resources Association (ELRA) , 1258 - 1265. ISBN 2-9517408-6-7

[img] Text
Available under licence : See the attached licence file.

Download (206Kb)


Morphological analyzers and part-of-speech taggers are key technologies for most text analysis applications. Our aim is to develop a part-of-speech tagger for annotating a wide range of Arabic text formats, domains and genres including both vowelized and non-vowelized text. Enriching the text with linguistic analysis will maximize the potential for corpus re-use in a wide range of applications. We foresee the advantage of enriching the text with part-of-speech tags of very fine-grained grammatical distinctions, which reflect expert interest in syntax and morphology, but not specific needs of end-users, because end-user applications are not known in advance. In this paper we review existing Arabic Part-of-Speech Taggers and tag-sets, and illustrate four different Arabic PoS tag-sets for a sample of Arabic text from the Quran. We describe the detailed fine-grained morphological feature tag set of Arabic, and the fine-grained Arabic morphological analyzer algorithm. We faced practical challenges in applying the morphological analyzer to the 100-million-word Web Arabic Corpus: we had to port the software to the National Grid Service, adapt the analyser to cope with spelling variations and errors, and utilise a Broad-Coverage Lexical Resource combining 23 traditional Arabic lexicons. Finally we outline the construction of a Gold Standard for comparative evaluation.

Item Type: Proceedings Paper
Institution: The University of Leeds
Academic Units: The University of Leeds > Faculty of Engineering (Leeds) > School of Computing (Leeds) > Artificial Intelligence & Biological Systems (Leeds)
Depositing User: Symplectic Publications
Date Deposited: 16 Nov 2010 10:34
Last Modified: 08 Dec 2014 16:16
Published Version: http://www.lrec-conf.org/proceedings/lrec2010/pdf/...
Status: Published
Publisher: European Language Resources Association (ELRA)
Related URLs:
URI: http://eprints.whiterose.ac.uk/id/eprint/42641

Actions (repository staff only: login required)