
There is a more recent version of this eprint available. Click here to view it.
Elgendy, I.T. orcid.org/0000-0002-8416-5480, Hierons, R.M. orcid.org/0000-0002-4771-1446 and McMinn, P. orcid.org/0000-0001-9137-7433 (Submitted: 2025) Empirically evaluating the use of bytecode for diversity-based test case prioritisation. [Preprint - arXiv] (Submitted)
Abstract
Regression testing assures software correctness after changes but is resource-intensive. Test Case Prioritisation (TCP) mitigates this by ordering tests to maximise early fault detection. Diversity-based TCP prioritises dissimilar tests, assuming they exercise different system parts and uncover more faults. Traditional static diversity-based TCP approaches (i.e., methods that utilise the dissimilarity of tests), like the state-of-the-art FAST approach, rely on textual diversity from test source code, which is effective but inefficient due to its relative verbosity and redundancies affecting similarity calculations. This paper is the first to study bytecode as the basis of diversity in TCP, leveraging its compactness for improved efficiency and accuracy. An empirical study on seven Defects4J projects shows that bytecode diversity improves fault detection by 2.3-7.8% over text-based TCP. It is also 2-3 orders of magnitude faster in one TCP approach and 2.5-6 times faster in FAST-based TCP. Filtering specific bytecode instructions improves efficiency up to fourfold while maintaining effectiveness, making bytecode diversity a superior static approach.
Metadata
Item Type: | Preprint |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2025 The Author(s). For reuse permissions, please contact the Author(s). |
Keywords: | test case prioritisation; diversity-based testing; bytecode diversity; textual diversity; Levenshtein distance; static analysis |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 08 Aug 2025 16:08 |
Last Modified: | 08 Aug 2025 16:08 |
Status: | Submitted |
Identification Number: | 10.48550/arXiv.2504.12790 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:230088 |
Available Versions of this Item
- Empirically evaluating the use of bytecode for diversity-based test case prioritisation. (deposited 08 Aug 2025 16:08) [Currently Displayed]