Zimmermann, Annette orcid.org/0000-0001-8214-550X and Lee-Stronach, Chad (2022) Proceed with Caution. Canadian journal of philosophy. pp. 6-25. ISSN 0045-5091
Abstract
It is becoming more common that the decision-makers in private and public institutions are predictive algorithmic systems, not humans. This article argues that relying on algorithmic systems is procedurally unjust in contexts involving background conditions of structural injustice. Under such nonideal conditions, algorithmic systems, if left to their own devices, cannot meet a necessary condition of procedural justice, because they fail to provide a sufficiently nuanced model of which cases count as relevantly similar. Resolving this problem requires deliberative capacities uniquely available to human agents. After exploring the limitations of existing formal algorithmic fairness strategies, the article argues that procedural justice requires that human agents relying wholly or in part on algorithmic systems proceed with caution: by avoiding doxastic negligence about algorithmic outputs, by exercising deliberative capacities when making similarity judgments, and by suspending belief and gathering additional information in light of higher-order uncertainty.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © The Author(s), 2021 |
Keywords: | philosophy of AI,political philosophy,moral philosophy,philosophy of law,procedural justice,structural injustice,algorithmic injustice,algorithmic decision-making,doxastic negligence,uncertainty,automation bias,intersectionality,epistemic duties |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Arts and Humanities (York) > Philosophy (York) |
Depositing User: | Pure (York) |
Date Deposited: | 14 Jun 2021 11:40 |
Last Modified: | 11 Dec 2024 00:17 |
Published Version: | https://doi.org/10.1017/can.2021.17 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1017/can.2021.17 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:175184 |