Townsend, Bev orcid.org/0000-0002-8486-6041, Parnell, Katie, Getir Yaman, Sinem et al. (2 more authors) (2025) Normative conflict resolution through human–autonomous agent interaction. Journal of responsible technology. 100114. ISSN 2666-6596
Abstract
We have become increasingly reliant on the decision-making capabilities of autonomous agents. These decisions are often executed under non-ideal conditions, offer significant moral risk, and directly affect human well-being. Such decisions may involve the choice to optimise one value over another: promoting safety over human autonomy, or ensuring accuracy over fairness, for example. All too often decision-making of this kind requires a level of normative evaluation involving ethically defensible moral choices and value judgements, compromises, and trade-offs. Guided by normative principles such decisions inform the possible courses of action the agent may take and may even change a set of established actionable courses. This paper seeks to map the decision-making processes in normative choice scenarios wherein autonomous agents are intrinsically linked to the decision process. A care-robot is used to illustrate how a normative choice - underpinned by normative principles - arises, where the agent must ‘choose’ an actionable path involving the administration of critical or non-critical medication. Critically, the choice is dependent upon the trade-off involving two normative principles: respect for human autonomy and the prevention of harm. An additional dimension is presented, that of the inclusion of the urgency of the medication to be administered, which further informs and changes the course of action to be followed. We offer a means to map decision-making involving a normative choice within a decision ladder using stakeholder input, and, using defeasibility, we show how specification rules with defeaters can be written to operationalise such choice.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2025 The Authors |
Keywords: | Normative conflict,SRK levels,Autonomous agents,Decision ladders,Decision-making,CHOICE,Defeasibility |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Social Sciences (York) > The York Law School The University of York > Faculty of Sciences (York) > Computer Science (York) The University of York > Faculty of Arts and Humanities (York) > Philosophy (York) |
Depositing User: | Pure (York) |
Date Deposited: | 26 Mar 2025 12:40 |
Last Modified: | 27 Mar 2025 05:27 |
Published Version: | https://doi.org/10.1016/j.jrt.2025.100114 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1016/j.jrt.2025.100114 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:224884 |
Download
Filename: 1-s2.0-S2666659625000101-main.pdf
Description: Normative conflict resolution through human–autonomous agent interaction
Licence: CC-BY 2.5