Alshammeri, M orcid.org/0000-0002-4645-3991, Atwell, E orcid.org/0000-0001-9395-3764 and Alsalka, MA orcid.org/0000-0003-3335-1918 (2021) A Siamese Transformer-based Architecture for Detecting Semantic Similarity in the Quran. In: The International Journal on Islamic Applications in Computer Science And Technology - IJASAT. 9th International Conference on Islamic Applications in Computer Science and Technologies (IMAN 2021), 04-05 Dec 2021, Online. Design For Scientific Renaissance .
Abstract
Semantic similarity detection is a crucial task in natural language comprehension and plays an important role in many NLP applications such as information extraction, text summarization, and text clustering. This paper focuses on the semantic similarity in the Quran. We propose a Siamese transformer-based architecture for pairwise semantic similarity detection in the Quran. We exploit Arabic pre-trained contextual representations to derive semantically meaningful verse embeddings. We then finetune the twin transformers networks on a semantic similarity dataset drawn from the Quran. We show that our model improves the Quranic semantic similarity measures and performance over previous studies.
Metadata
Authors/Creators: |
|
---|---|
Copyright, Publisher and Additional Information: | This is protected by copyright. All rights reserved. This is an author produced version of an article published in The International Journal on Islamic Applications in Computer Science And Technology. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | The Quran, Semantic Similarity, Transformer, Pre-trained Contextual Representations, Siamese Transformer-Networks, AraBERT, SBERT |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 04 Jan 2022 14:50 |
Last Modified: | 12 May 2022 15:40 |
Published Version: | http://www.sign-ific-ance.co.uk/index.php/IJASAT/i... |
Status: | Published |
Publisher: | Design For Scientific Renaissance |