Segura, S., Fraser, G., Sanchez, A.B. et al. (1 more author) (2016) A Survey on Metamorphic Testing. IEEE Transactions on Software Engineering, 42 (9). pp. 805-824. ISSN 0098-5589
Abstract
A test oracle determines whether a test execution reveals a fault, often by comparing the observed program output to the expected output. This is not always practical, for example when a program's input-output relation is complex and difficult to capture formally. Metamorphic testing provides an alternative, where correctness is not determined by checking an individual concrete output, but by applying a transformation to a test input and observing how the program output “morphs” into a different one as a result. Since the introduction of such metamorphic relations in 1998, many contributions on metamorphic testing have been made, and the technique has seen successful applications in a variety of domains, ranging from web services to computer graphics. This article provides a comprehensive survey on metamorphic testing: It summarises the research results and application areas, and analyses common practice in empirical studies of metamorphic testing as well as the main open challenges.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2016 IEEE. This is an author produced version of a paper subsequently published in IEEE Transactions on Software Engineering. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Metamorphic testing; oracle problem; survey |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 11 Jan 2017 12:19 |
Last Modified: | 21 Mar 2018 10:13 |
Published Version: | https://doi.org/10.1109/TSE.2016.2532875 |
Status: | Published |
Publisher: | Institute of Electrical and Electronics Engineers |
Refereed: | Yes |
Identification Number: | 10.1109/TSE.2016.2532875 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:110335 |