Sawalha, M and Atwell, ES (2010) Fine-grain morphological analyzer and part-of-speech tagger for Arabic text. In: Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10). Language Resource and Evaluation Conference LREC 2010, 17 May 2010 - 23 May 2010, Valleta, Malta. European Language Resources Association (ELRA) , 1258 - 1265. ISBN 2-9517408-6-7Full text available as:
Available under licence : See the attached licence file.
Morphological analyzers and part-of-speech taggers are key technologies for most text analysis applications. Our aim is to develop a part-of-speech tagger for annotating a wide range of Arabic text formats, domains and genres including both vowelized and non-vowelized text. Enriching the text with linguistic analysis will maximize the potential for corpus re-use in a wide range of applications. We foresee the advantage of enriching the text with part-of-speech tags of very fine-grained grammatical distinctions, which reflect expert interest in syntax and morphology, but not specific needs of end-users, because end-user applications are not known in advance. In this paper we review existing Arabic Part-of-Speech Taggers and tag-sets, and illustrate four different Arabic PoS tag-sets for a sample of Arabic text from the Quran. We describe the detailed fine-grained morphological feature tag set of Arabic, and the fine-grained Arabic morphological analyzer algorithm. We faced practical challenges in applying the morphological analyzer to the 100-million-word Web Arabic Corpus: we had to port the software to the National Grid Service, adapt the analyser to cope with spelling variations and errors, and utilise a Broad-Coverage Lexical Resource combining 23 traditional Arabic lexicons. Finally we outline the construction of a Gold Standard for comparative evaluation.
|Item Type:||Proceedings Paper|
|Institution:||The University of Leeds|
|Academic Units:||The University of Leeds > Faculty of Engineering (Leeds) > School of Computing (Leeds) > Artificial Intelligence & Biological Systems (Leeds)|
|Depositing User:||Symplectic Publications|
|Date Deposited:||16 Nov 2010 10:34|
|Last Modified:||08 Dec 2014 16:16|
|Publisher:||European Language Resources Association (ELRA)|