Sneyd, A. and Stevenson, M. orcid.org/0000-0002-9483-6006 (2021) Stopping criteria for technology assisted reviews based on counting processes. In: SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR 2021 : 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 11-15 Jul 2021, Virtual conference. ACM Digital Library , pp. 2293-2297. ISBN 9781450380379
Abstract
Technology Assisted Review (TAR) aims to minimise the manual judgements required to identify relevant documents. Reductions in workload are dependent on a reviewer being able to make an informed decision about when to stop examining documents. Counting processes offer a theoretically sound approach to creating stopping criteria for TAR approaches that are based on analysis of the rate at which relevant documents are observed. This paper introduces two modifications to existing approaches: application of a Cox Process (a counting process which has not previously been used for this problem) and use of a rate function based on a power law. Experiments on the CLEF 2017 e-Health TAR collection demonstrates that these approaches produces results that are superior to those reported previously.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2021 The Authors. This is an author-produced version of a paper subsequently published in SIGIR '21: Proceedings. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Information systems → Retrieval effectiveness; Retrieval efficiency |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 09 Jun 2021 12:38 |
Last Modified: | 12 Jul 2021 13:01 |
Status: | Published |
Publisher: | ACM Digital Library |
Refereed: | Yes |
Identification Number: | 10.1145/3404835.3463013 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:175032 |