Conference Paper/Proceeding/Abstract 182 views 27 downloads
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment
Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024., Volume: 3701
Swansea University Authors:
Ben Wilson , Matt Roach
, Bertie Muller
-
PDF | Version of Record
©2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).
Download (956.55KB)
Abstract
We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) fra...
Published in: | Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024. |
---|---|
ISSN: | 1613-0073 |
Published: |
2024
|
Online Access: |
Check full text
|
URI: | https://cronfa.swan.ac.uk/Record/cronfa67653 |
first_indexed |
2024-09-20T16:35:57Z |
---|---|
last_indexed |
2024-11-25T14:20:33Z |
id |
cronfa67653 |
recordtype |
SURis |
fullrecord |
<?xml version="1.0"?><rfc1807><datestamp>2024-10-09T14:31:41.2616193</datestamp><bib-version>v2</bib-version><id>67653</id><entry>2024-09-11</entry><title>Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment</title><swanseaauthors><author><sid>a854728f3952ca0b74a49f9286a9b0e2</sid><ORCID>0009-0004-5663-5854</ORCID><firstname>Ben</firstname><surname>Wilson</surname><name>Ben Wilson</name><active>true</active><ethesisStudent>false</ethesisStudent></author><author><sid>9722c301d5bbdc96e967cdc629290fec</sid><ORCID>0000-0002-1486-5537</ORCID><firstname>Matt</firstname><surname>Roach</surname><name>Matt Roach</name><active>true</active><ethesisStudent>false</ethesisStudent></author><author><sid>a9373756f492363d8453ecf3b828b811</sid><firstname>Bertie</firstname><surname>Muller</surname><name>Bertie Muller</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2024-09-11</date><deptcode>MACS</deptcode><abstract>We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) framework to structure the presentation of our evaluation. We highlight three key lessons that should inform not only future deployments and evaluations, but future design work itself. The lessons are to attend to wider impacts, incorporate quality improvement and quality assurance techniques and employ participatory design, iterative development and formative evaluation.</abstract><type>Conference Paper/Proceeding/Abstract</type><journal>Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024.</journal><volume>3701</volume><journalNumber/><paginationStart/><paginationEnd/><publisher/><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint/><issnElectronic>1613-0073</issnElectronic><keywords/><publishedDay>3</publishedDay><publishedMonth>6</publishedMonth><publishedYear>2024</publishedYear><publishedDate>2024-06-03</publishedDate><doi/><url>https://ceur-ws.org/Vol-3701/paper11.pdf</url><notes>https://ceur-ws.org/Vol-3701/</notes><college>COLLEGE NANME</college><department>Mathematics and Computer Science School</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>MACS</DepartmentCode><institution>Swansea University</institution><apcterm>Not Required</apcterm><funders/><projectreference/><lastEdited>2024-10-09T14:31:41.2616193</lastEdited><Created>2024-09-11T17:10:34.0796939</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Ben</firstname><surname>Wilson</surname><orcid>0009-0004-5663-5854</orcid><order>1</order></author><author><firstname>Darren</firstname><surname>Scott</surname><orcid>https://orcid.org/0000-0001-7738-8662</orcid><order>2</order></author><author><firstname>Matt</firstname><surname>Roach</surname><orcid>0000-0002-1486-5537</orcid><order>3</order></author><author><firstname>Emily</firstname><surname>Nielsen</surname><orcid>https://orcid.org/0000-0003-2389-541X</orcid><order>4</order></author><author><firstname>Bertie</firstname><surname>Muller</surname><order>5</order></author></authors><documents><document><filename>67653__31423__ea1b980a981c4a628dca965371c95d8e.pdf</filename><originalFilename>Lessons_from_primary_care_deployment.pdf</originalFilename><uploaded>2024-09-20T16:01:51.9334243</uploaded><type>Output</type><contentLength>979508</contentLength><contentType>application/pdf</contentType><version>Version of Record</version><cronfaStatus>true</cronfaStatus><documentNotes>©2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).</documentNotes><copyrightCorrect>true</copyrightCorrect><language>eng</language><licence>https://creativecommons.org/licenses/by/4.0/deed.en</licence></document></documents><OutputDurs/></rfc1807> |
spelling |
2024-10-09T14:31:41.2616193 v2 67653 2024-09-11 Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment a854728f3952ca0b74a49f9286a9b0e2 0009-0004-5663-5854 Ben Wilson Ben Wilson true false 9722c301d5bbdc96e967cdc629290fec 0000-0002-1486-5537 Matt Roach Matt Roach true false a9373756f492363d8453ecf3b828b811 Bertie Muller Bertie Muller true false 2024-09-11 MACS We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) framework to structure the presentation of our evaluation. We highlight three key lessons that should inform not only future deployments and evaluations, but future design work itself. The lessons are to attend to wider impacts, incorporate quality improvement and quality assurance techniques and employ participatory design, iterative development and formative evaluation. Conference Paper/Proceeding/Abstract Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024. 3701 1613-0073 3 6 2024 2024-06-03 https://ceur-ws.org/Vol-3701/paper11.pdf https://ceur-ws.org/Vol-3701/ COLLEGE NANME Mathematics and Computer Science School COLLEGE CODE MACS Swansea University Not Required 2024-10-09T14:31:41.2616193 2024-09-11T17:10:34.0796939 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Ben Wilson 0009-0004-5663-5854 1 Darren Scott https://orcid.org/0000-0001-7738-8662 2 Matt Roach 0000-0002-1486-5537 3 Emily Nielsen https://orcid.org/0000-0003-2389-541X 4 Bertie Muller 5 67653__31423__ea1b980a981c4a628dca965371c95d8e.pdf Lessons_from_primary_care_deployment.pdf 2024-09-20T16:01:51.9334243 Output 979508 application/pdf Version of Record true ©2024 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). true eng https://creativecommons.org/licenses/by/4.0/deed.en |
title |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment |
spellingShingle |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment Ben Wilson Matt Roach Bertie Muller |
title_short |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment |
title_full |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment |
title_fullStr |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment |
title_full_unstemmed |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment |
title_sort |
Designing for Situated AI-Human Decision Making: Lessons Learned from a Primary Care Deployment |
author_id_str_mv |
a854728f3952ca0b74a49f9286a9b0e2 9722c301d5bbdc96e967cdc629290fec a9373756f492363d8453ecf3b828b811 |
author_id_fullname_str_mv |
a854728f3952ca0b74a49f9286a9b0e2_***_Ben Wilson 9722c301d5bbdc96e967cdc629290fec_***_Matt Roach a9373756f492363d8453ecf3b828b811_***_Bertie Muller |
author |
Ben Wilson Matt Roach Bertie Muller |
author2 |
Ben Wilson Darren Scott Matt Roach Emily Nielsen Bertie Muller |
format |
Conference Paper/Proceeding/Abstract |
container_title |
Proceedings of the 1st International Workshop on Designing and Building Hybrid Human–AI Systems (SYNERGY 2024), Arenzano (Genoa), Italy, June 03, 2024. |
container_volume |
3701 |
publishDate |
2024 |
institution |
Swansea University |
issn |
1613-0073 |
college_str |
Faculty of Science and Engineering |
hierarchytype |
|
hierarchy_top_id |
facultyofscienceandengineering |
hierarchy_top_title |
Faculty of Science and Engineering |
hierarchy_parent_id |
facultyofscienceandengineering |
hierarchy_parent_title |
Faculty of Science and Engineering |
department_str |
School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science |
url |
https://ceur-ws.org/Vol-3701/paper11.pdf |
document_store_str |
1 |
active_str |
0 |
description |
We present a case study of AI deployment in a UK primary care (family doctor) setting. This demonstrates some of the challenges of real-world deployment of AI-human systems for decision-making. We use the seven domains of the NASSS (nonadoption, abandonment, scale-up, spread, and sustainability) framework to structure the presentation of our evaluation. We highlight three key lessons that should inform not only future deployments and evaluations, but future design work itself. The lessons are to attend to wider impacts, incorporate quality improvement and quality assurance techniques and employ participatory design, iterative development and formative evaluation. |
published_date |
2024-06-03T08:23:18Z |
_version_ |
1826285314164916224 |
score |
11.053695 |