Patel, K. and Hierons, R.M. orcid.org/0000-0002-4771-1446 (2019) A partial oracle for uniformity statistics. Software Quality Journal, 27 (4). pp. 1419-1447. ISSN 0963-9314
Abstract
This paper investigates the problem of testing implementations of uniformity statistics. In this paper we used Metamorphic Testing to address the oracle problem, of checking the output of one or more test executions, for uniformity statistics. We defined a partial oracle that uses regression analysis (a Regression Model based Metamorphic Relation).
We investigated the effectiveness of our partial oracle. We found that the technique can achieve mutation scores ranging from 77.78% to 100%, and tends towards higher mutation scores in this range. These results are promising, and suggest that the Regression Model based Metamorphic Relation approach is a viable method of alleviating the oracle problem in implementations of uniformity statistics, and potentially other classes of statistics e.g. correlation statistics.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2019 The Author(s). This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
Keywords: | Uniformity Statistics; Oracle Problem; Non-testable Systems; Metamorphic Testing; Regression Model based Metamorphic Relation; Metamorphic Relation |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Funding Information: | Funder Grant number Engineering and Physical Science Research Council (EPSRC) EP/P006116/1 |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 23 Jul 2019 10:50 |
Last Modified: | 07 Dec 2021 14:56 |
Status: | Published |
Publisher: | Springer Nature |
Refereed: | Yes |
Identification Number: | 10.1007/s11219-019-09459-0 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:148216 |
Download
Filename: Patel-Hierons2019_Article_APartialOracleForUniformitySta.pdf
Licence: CC-BY 4.0