Woo, S. orcid.org/0009-0008-5943-1696, Kim, D. orcid.org/0000-0002-9570-4734, Shin, D. orcid.org/0000-0002-0840-6449 et al. (1 more author) (2026) Branch-level fault localization in ADS planning via temporal coverage analysis. Proceedings of the ACM on Software Engineering, 3 (ISSTA). pp. 1010-1032. ISSN: 2994-970X
Abstract
Planning failures in Automated Driving Systems (ADS) are increasingly detected through simulation-based testing, yet localizing their root causes within planning code remains a major challenge. Planning modules execute complex rule-based decision logic over hundreds of frames in a closed-loop interaction with the environment, where faults trigger observable failures only after temporal gaps and under specific execution contexts. These characteristics make traditional spectrum-based fault localization ineffective, as faulty behavior is obscured by execution-level coverage aggregation and limited test diversity. In this paper, we study the problem of debugging planning failures and present a temporal coverage analysis approach for localizing faults in rule-based planning modules. Our key insight is that, while execution-aggregated coverage masks fault behavior, frame-level execution dynamics reveal distinctive temporal signatures that indicate when and how faulty branches activate. Leveraging this insight, our approach first identifies a suspicious frame using planning semantics, and then ranks candidate branches by analyzing their execution behavior within a localized temporal window. We evaluate our approach on 221 reproducible non-collision Apollo planning failures, covering immobility and emergency mission failures. Our results show that temporal coverage analysis enables accurate suspicious-frame identification and substantially reduces branch inspection effort compared to oracle-based and random baselines, effectively localizing faults from a single failing execution. We further analyze failure cases that lack observable execution signals to clarify the fundamental limits of execution-based localization. Overall, this work demonstrates that temporal execution analysis provides a practical and effective foundation for debugging planning failures in rule-based ADS planning modules.
Metadata
| Item Type: | Article |
|---|---|
| Authors/Creators: | |
| Copyright, Publisher and Additional Information: | © 2026 Copyright held by the owner/author(s). This work is licensed under a Creative Commons Attribution International 4.0 License. https://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Automated Driving System; Debugging; Fault Localization |
| Dates: |
|
| Institution: | The University of Sheffield |
| Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
| Funding Information: | Funder Grant number ENGINEERING AND PHYSICAL SCIENCE RESEARCH COUNCIL EP/Y014219/1 |
| Date Deposited: | 20 Oct 2026 15:00 |
| Last Modified: | 20 Oct 2026 15:00 |
| Status: | Published |
| Publisher: | Association for Computing Machinery (ACM) |
| Refereed: | Yes |
| Identification Number: | 10.1145/3832135 |
| Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:246772 |
Download
Filename: 3832135.pdf
Licence: CC-BY 4.0

CORE (COnnecting REpositories)
CORE (COnnecting REpositories)