Castro-Cabrera, M. Carmen de, García-Dominguez, Antonio orcid.org/0000-0002-4744-9150 and Medina-Bulo, Inmaculada (2023) CMBMeTest:Generation of Test Suites Using Model-Based Testing Plus Constraint Programming and Metamorphic Testing. Electronics (Switzerland). 18. ISSN 2079-9292
Abstract
Various software testing techniques have been shown to be successful in producing high-quality test suites for software where the code is not accessible (black-box approach). Nevertheless, no method has been found to guide combining some of these in a general way. In this study, a test suite generation method for black-box software called CMBMeTest was created to respond to these challenges. It employs several coupled software testing techniques, namely, model-based testing (MBT), constraint programming (CP), and metamorphic testing (MT). CMBMeTest provides step-by-step instructions for using the information available (such as program specifications, inputs and outputs) to create an initial test suite that covers the model obtained, using a combination of MBT and CP (referred to as MBT+CP). Furthermore, using the metamorphic relations (MRs) of MT, a better test suite was produced from that initial test suite. The method allows particular stages to be iterated to improve the results by building new models and new MRs. A comprehensive case study was conducted, employing CMBMeTest to produce encouraging results. Mutation testing was used to evaluate the test suite, and the first round produced a high mutation score. A more detailed model was used to repeat the process, with similar outcomes.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | Publisher Copyright: © 2023 by the authors. |
Keywords: | constraint programming systems,constraint solvers,metamorphic relations,model-based testing,test case generation,test suites |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 25 Sep 2024 10:50 |
Last Modified: | 19 Nov 2024 00:46 |
Published Version: | https://doi.org/10.3390/electronics13010018 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.3390/electronics13010018 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:217614 |
Download
Filename: electronics-13-00018-v3.pdf
Description: CMBMeTest: Generation of Test Suites Using Model-Based Testing Plus Constraint Programming and Metamorphic Testing
Licence: CC-BY 2.5