Wang, Y., Vyas, J., Liu, T. et al. (1 more author) (2026) Closed-loop control with rule-aligned small language models and multi-agent self-correction. In: 2026 IEEE Conference on Control Technology and Applications (CCTA). 2026 IEEE Conference on Control Technology and Applications (CCTA), 12-14 Aug 2026, Vancouver, BC, Canada. Institute of Electrical and Electronics Engineers (IEEE), pp. 52-57. ISBN: 9798319531476. ISSN: 2768-0762. EISSN: 2768-0770.
Abstract
A key step toward autonomous industrial operation is the ability to create and reconfigure control policies from natural-language requirement specifications, with minimal or no manual redesign. In this setting, policy generation by AI agents can be a credible path when paired with a plant-aware validator (e.g., a digital twin) that can check generated candidate actions before execution. However, practical deployment is constrained by inference latency and compute footprint: large cloud-based models are often too slow, opaque, or data-sensitive for edge closed-loop use. This work investigates whether a compact Small Language Model (SLM) can be retrained for control reasoning and embedded in a validator-guided correction loop. We use a Qwen2.5-1.5B model aligned via Group Relative Policy Optimization (GRPO), combined with (i) an action agent, (ii) a symbolic/digital-twin-style validation layer, and (iii) a reprompting agent that iteratively steers outputs toward valid actions. In randomized thermal-control simulations (30 experiments with 500 steps each), the framework achieves 91.5% average action-alignment accuracy (86.3%-100% across cases) at 3.84s mean inference latency. Under symbolic re-mapping, it maintains a 95% in-range rate, indicating robust physical regulation despite reduced token-level agreement. These results support SLM+validator architectures as a practical path toward reconfigurable autonomous control at the edge.
Metadata
| Item Type: | Proceedings Paper |
|---|---|
| Authors/Creators: |
|
| Copyright, Publisher and Additional Information: | © 2026 The Authors. Except as otherwise noted, this author-accepted version of a conference paper published in 2026 IEEE Conference on Control Technology and Applications (CCTA) is made available via the University of Sheffield Research Publications and Copyright Policy under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | Autonomous systems; Small language models; Edge AI; Generative AI |
| Dates: |
|
| Institution: | The University of Sheffield |
| Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
| Date Deposited: | 21 Oct 2026 15:42 |
| Last Modified: | 21 Oct 2026 15:42 |
| Status: | Published |
| Publisher: | Institute of Electrical and Electronics Engineers (IEEE) |
| Refereed: | Yes |
| Identification Number: | 10.1109/ccta62090.2026.11684321 |
| Related URLs: | |
| Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:246973 |
Download
Filename: 2607.09713v1.pdf
Licence: CC-BY 4.0
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)