No Cover Image

Conference Paper/Proceeding/Abstract 182 views 27 downloads

Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment

Ben Wilson Orcid Logo, Darren Scott Orcid Logo, Matt Roach Orcid Logo, Emily Nielsen Orcid Logo, Bertie Muller

Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024., Volume: 3701

Swansea University Authors: Ben Wilson Orcid Logo, Matt Roach Orcid Logo, Bertie Muller

  • Lessons_from_primary_care_deployment.pdf

    PDF | Version of Record

    ©2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

    Download (956.55KB)

Abstract

We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) fra...

Full description

Published in: Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024.
ISSN: 1613-0073
Published: 2024
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa67653
first_indexed 2024-09-20T16:35:57Z
last_indexed 2024-11-25T14:20:33Z
id cronfa67653
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807><datestamp>2024-10-09T14:31:41.2616193</datestamp><bib-version>v2</bib-version><id>67653</id><entry>2024-09-11</entry><title>Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment</title><swanseaauthors><author><sid>a854728f3952ca0b74a49f9286a9b0e2</sid><ORCID>0009-0004-5663-5854</ORCID><firstname>Ben</firstname><surname>Wilson</surname><name>Ben Wilson</name><active>true</active><ethesisStudent>false</ethesisStudent></author><author><sid>9722c301d5bbdc96e967cdc629290fec</sid><ORCID>0000-0002-1486-5537</ORCID><firstname>Matt</firstname><surname>Roach</surname><name>Matt Roach</name><active>true</active><ethesisStudent>false</ethesisStudent></author><author><sid>a9373756f492363d8453ecf3b828b811</sid><firstname>Bertie</firstname><surname>Muller</surname><name>Bertie Muller</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2024-09-11</date><deptcode>MACS</deptcode><abstract>We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) framework to structure the presentation of our evaluation. We highlight three key lessons that should inform not only future deployments and evaluations, but future design work itself. The lessons are to attend to wider impacts, incorporate quality improvement and quality assurance techniques and employ participatory design, iterative development and formative evaluation.</abstract><type>Conference Paper/Proceeding/Abstract</type><journal>Proceedings of the 1st International Workshop on Designing and Building Hybrid Human&#x2013;AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024.</journal><volume>3701</volume><journalNumber/><paginationStart/><paginationEnd/><publisher/><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint/><issnElectronic>1613-0073</issnElectronic><keywords/><publishedDay>3</publishedDay><publishedMonth>6</publishedMonth><publishedYear>2024</publishedYear><publishedDate>2024-06-03</publishedDate><doi/><url>https://ceur-ws.org/Vol-3701/paper11.pdf</url><notes>https://ceur-ws.org/Vol-3701/</notes><college>COLLEGE NANME</college><department>Mathematics and Computer Science School</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>MACS</DepartmentCode><institution>Swansea University</institution><apcterm>Not Required</apcterm><funders/><projectreference/><lastEdited>2024-10-09T14:31:41.2616193</lastEdited><Created>2024-09-11T17:10:34.0796939</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Ben</firstname><surname>Wilson</surname><orcid>0009-0004-5663-5854</orcid><order>1</order></author><author><firstname>Darren</firstname><surname>Scott</surname><orcid>https://orcid.org/0000-0001-7738-8662</orcid><order>2</order></author><author><firstname>Matt</firstname><surname>Roach</surname><orcid>0000-0002-1486-5537</orcid><order>3</order></author><author><firstname>Emily</firstname><surname>Nielsen</surname><orcid>https://orcid.org/0000-0003-2389-541X</orcid><order>4</order></author><author><firstname>Bertie</firstname><surname>Muller</surname><order>5</order></author></authors><documents><document><filename>67653__31423__ea1b980a981c4a628dca965371c95d8e.pdf</filename><originalFilename>Lessons_from_primary_care_deployment.pdf</originalFilename><uploaded>2024-09-20T16:01:51.9334243</uploaded><type>Output</type><contentLength>979508</contentLength><contentType>application/pdf</contentType><version>Version of Record</version><cronfaStatus>true</cronfaStatus><documentNotes>&#xA9;2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</documentNotes><copyrightCorrect>true</copyrightCorrect><language>eng</language><licence>https://creativecommons.org/licenses/by/4.0/deed.en</licence></document></documents><OutputDurs/></rfc1807>
spelling 2024-10-09T14:31:41.2616193 v2 67653 2024-09-11 Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment a854728f3952ca0b74a49f9286a9b0e2 0009-0004-5663-5854 Ben Wilson Ben Wilson true false 9722c301d5bbdc96e967cdc629290fec 0000-0002-1486-5537 Matt Roach Matt Roach true false a9373756f492363d8453ecf3b828b811 Bertie Muller Bertie Muller true false 2024-09-11 MACS We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) framework to structure the presentation of our evaluation. We highlight three key lessons that should inform not only future deployments and evaluations, but future design work itself. The lessons are to attend to wider impacts, incorporate quality improvement and quality assurance techniques and employ participatory design, iterative development and formative evaluation. Conference Paper/Proceeding/Abstract Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024. 3701 1613-0073 3 6 2024 2024-06-03 https://ceur-ws.org/Vol-3701/paper11.pdf https://ceur-ws.org/Vol-3701/ COLLEGE NANME Mathematics and Computer Science School COLLEGE CODE MACS Swansea University Not Required 2024-10-09T14:31:41.2616193 2024-09-11T17:10:34.0796939 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Ben Wilson 0009-0004-5663-5854 1 Darren Scott https://orcid.org/0000-0001-7738-8662 2 Matt Roach 0000-0002-1486-5537 3 Emily Nielsen https://orcid.org/0000-0003-2389-541X 4 Bertie Muller 5 67653__31423__ea1b980a981c4a628dca965371c95d8e.pdf Lessons_from_primary_care_deployment.pdf 2024-09-20T16:01:51.9334243 Output 979508 application/pdf Version of Record true ©2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). true eng https://creativecommons.org/licenses/by/4.0/deed.en
title Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
spellingShingle Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
Ben Wilson
Matt Roach
Bertie Muller
title_short Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
title_full Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
title_fullStr Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
title_full_unstemmed Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
title_sort Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
author_id_str_mv a854728f3952ca0b74a49f9286a9b0e2
9722c301d5bbdc96e967cdc629290fec
a9373756f492363d8453ecf3b828b811
author_id_fullname_str_mv a854728f3952ca0b74a49f9286a9b0e2_***_Ben Wilson
9722c301d5bbdc96e967cdc629290fec_***_Matt Roach
a9373756f492363d8453ecf3b828b811_***_Bertie Muller
author Ben Wilson
Matt Roach
Bertie Muller
author2 Ben Wilson
Darren Scott
Matt Roach
Emily Nielsen
Bertie Muller
format Conference Paper/Proceeding/Abstract
container_title Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024.
container_volume 3701
publishDate 2024
institution Swansea University
issn 1613-0073
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science
url https://ceur-ws.org/Vol-3701/paper11.pdf
document_store_str 1
active_str 0
description We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) framework to structure the presentation of our evaluation. We highlight three key lessons that should inform not only future deployments and evaluations, but future design work itself. The lessons are to attend to wider impacts, incorporate quality improvement and quality assurance techniques and employ participatory design, iterative development and formative evaluation.
published_date 2024-06-03T08:23:18Z
_version_ 1826285314164916224
score 11.053695