Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning

Li, F., Hogg, D.C. orcid.org/0000-0002-6125-9564 and Cohn, A.G. orcid.org/0000-0002-7652-8907 (2024) Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning. In: Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence, 03-09 Aug 2024, Jeju, Korea. International Joint Conferences on Artificial Intelligence , pp. 6342-6349. ISBN 978-1-956792-04-1

Abstract

Metadata

Item Type: Proceedings Paper
Authors/Creators:
Keywords: Natural Language Processing; NLP; Resources and evaluation; Knowledge Representation and Reasoning; KRR; Qualitative, geometric, spatial, and temporal reasoning; Constraint Satisfaction and Optimization; CSO; Applications; Knowledge Representation and Reasoning; KRR; Learning and reasoning
Dates:
  • Published: 1 August 2024
Institution: The University of Leeds
Academic Units: The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds)
Depositing User: Symplectic Publications
Date Deposited: 10 Mar 2025 11:22
Last Modified: 10 Mar 2025 11:22
Status: Published
Publisher: International Joint Conferences on Artificial Intelligence
Identification Number: 10.24963/ijcai.2024/701
Related URLs:
Open Archives Initiative ID (OAI ID):

Download not available

A full text copy of this item is not currently available from White Rose Research Online

Export

Statistics