Johnson, O.A. orcid.org/0000-0003-3998-541X, McCrorie, C. orcid.org/0000-0002-2673-6839, McInerney, C. orcid.org/0000-0001-7620-7110 et al. (7 more authors) (2024) Implementing an artificial intelligence command centre in the NHS: a mixed-methods study. Health and Social Care Delivery Research, 12 (41). ISSN 2755-0060
Abstract
Background
Hospital ‘command centres’ use digital technologies to collect, analyse and present real-time information that may improve patient flow and patient safety. Bradford Royal Infirmary has trialled this approach and presents an opportunity to evaluate effectiveness to inform future adoption in the United Kingdom.
Objective
To evaluate the impact of the Bradford Command Centre on patient care and organisational processes.
Design
A comparative mixed-methods study. Operational data from a study and control site were collected and analysed. The intervention was observed, and staff at both sites were interviewed. Analysis was grounded in a literature review and the results were synthesised to form conclusions about the intervention.
Setting
The study site was Bradford Royal Infirmary, a large teaching hospital in the city of Bradford, United Kingdom. The control site was Huddersfield Royal Infirmary in the nearby city of Huddersfield.
Participants
Thirty-six staff members were interviewed and/or observed.
Intervention
The implementation of a digitally enabled hospital command centre.
Main outcome measures
Qualitative perspectives on hospital management. Quantitative metrics on patient flow, patient safety, data quality.
Data sources
Anonymised electronic health record data. Ethnographic observations including interviews with hospital staff. Cross-industry review including relevant literature and expert panel interviews.
Results
The Command Centre was implemented successfully and has improved staff confidence of better operational control. Unintended consequences included tensions between localised and centralised decision-making and variable confidence in the quality of data available. The Command Centre supported the hospital through the COVID-19 pandemic, but the direct impact of the Command Centre was difficult to measure as the pandemic forced all hospitals, including the study and control sites, to innovate rapidly. Late in the study we learnt that the control site had visited the study site and replicated some aspects of the command centre themselves; we were unable to explore this in detail. There was no significant difference between pre- and post-intervention periods for the quantitative outcome measures and no conclusive impact on patient flow and data quality. Staff and patients supported the command-centre approaches but patients expressed concern that individual needs might get lost to ‘the system’.
Conclusions
Qualitative evidence suggests the Command Centre implementation was successful, but it proved challenging to link quantitative evidence to specific technology interventions. Staff were positive about the benefits and emphasised that these came from the way they adapted to and used the new technology rather than the technology per se.
Limitations
The COVID-19 pandemic disrupted care patterns and forced rapid innovation which reduced our ability to compare study and control sites and data before, during and after the intervention.
Future work
We plan to follow developments at Bradford and in command centres in the National Health Service in order to share learning. Our mixed-methods approach should be of interest to future studies attempting similar evaluation of complex digitally enabled whole-system changes.
Study registration
The study is registered as IRAS No.: 285933.
Funding
This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: NIHR129483) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 41. See the NIHR Funding and Awards website for further award information.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2024 Johnson et al. This work was produced by Johnson et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This is an Open Access publication distributed under the terms of the Creative Commons Attribution CC BY 4.0 licence, which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. See: https://creativecommons.org/licenses/by/4.0/. For attribution the title, original author(s), the publication source – NIHR Journals Library, and the DOI of the publication must be cited. |
Keywords: | Command centre; Data quality; Electronic health records; Ethnography; Health Services; Hospitals; Information Technology; Learning Health Systems; Mixed Methods; Patient Care; Patient Safety; Process Mining; Humans; United Kingdom; State Medicine; Artificial Intelligence; COVID-19; Patient Safety; Hospitals, Teaching; Qualitative Research; SARS-CoV-2; Interviews as Topic |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Medicine, Dentistry and Health (Sheffield) > School of Medicine and Population Health |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 13 Dec 2024 16:43 |
Last Modified: | 13 Dec 2024 16:43 |
Status: | Published |
Publisher: | National Institute for Health and Care Research |
Refereed: | Yes |
Identification Number: | 10.3310/tatm3277 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:220388 |