White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Constructing and Using Broad-coverage Lexical Resource for Enhancing Morphological Analysis of Arabic

Sawalha, M. and Atwell, E.S. (2010) Constructing and Using Broad-coverage Lexical Resource for Enhancing Morphological Analysis of Arabic. In: Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10). Language Resource and Evaluation Conference LREC 2010, 17 May 2010 - 23 May 2010, Valleta, Malta. European Language Resources Association (ELRA) , 282 - 287 (6). ISBN 2-9517408-6-7

Full text available as:
[img] Text
sawalha10lrecA_front.pdf

Download (238Kb)

Abstract

Broad-coverage language resources which provide prior linguistic knowledge must improve the accuracy and the performance of NLP applications. We are constructing a broad-coverage lexical resource to improve the accuracy of morphological analyzers and part-of-speech taggers of Arabic text. Over the past 1200 years, many different kinds of Arabic language lexicons were constructed; these lexicons are different in ordering, size and aim or goal of construction. We collected 23 machine-readable lexicons, which are freely available on the web. We combined lexical resources into one large broad-coverage lexical resource by extracting information from disparate formats and merging traditional Arabic lexicons. To evaluate the broad-coverage lexical resource we computed coverage over the Qur’an, the Corpus of Contemporary Arabic, and a sample from the Arabic Web Corpus, using two methods. Counting exact word matches between test corpora and lexicon scored about 65-68%; Arabic has a rich morphology with many combinations of roots, affixes and clitics, so about a third of words in the corpora did not have an exact match in the lexicon. The second approach is to compute coverage in terms of use in a lemmatizer program, which strips clitics to look for a match for the underlying lexeme; this scored about 82-85%.

Item Type: Proceedings Paper
Institution: The University of Leeds
Academic Units: The University of Leeds > Faculty of Engineering (Leeds) > School of Computing (Leeds)
Depositing User: Symplectic Publications
Date Deposited: 15 Nov 2010 18:13
Last Modified: 08 Feb 2013 17:29
Published Version: http://www.lrec-conf.org/proceedings/lrec2010/pdf/...
Status: Published
Publisher: European Language Resources Association (ELRA)
Related URLs:
URI: http://eprints.whiterose.ac.uk/id/eprint/42640

Actions (repository staff only: login required)