No Cover Image

Journal article 729 views 107 downloads

System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis

Maciej Hyzy Orcid Logo, Raymond Bond Orcid Logo, Maurice Mulvenna Orcid Logo, Lu Bai Orcid Logo, Alan Dix Orcid Logo, Simon Leigh Orcid Logo, Sophie Hunt Orcid Logo

JMIR mHealth and uHealth, Volume: 10, Issue: 8, Start page: e37290

Swansea University Author: Alan Dix Orcid Logo

  • 60682.VOR.pdf

    PDF | Version of Record

    This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work.

    Download (367.79KB)

Check full text

DOI (Published version): 10.2196/37290

Abstract

Background:The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS scale was not specifically designed to evaluate mobile apps, or indeed Digital Health Apps (DHAs).Objective:The objective of this s...

Full description

Published in: JMIR mHealth and uHealth
ISSN: 2291-5222
Published: JMIR Publications Inc. 2022
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa60682
Tags: Add Tag
No Tags, Be the first to tag this record!
first_indexed 2022-08-04T10:00:27Z
last_indexed 2023-01-13T19:20:59Z
id cronfa60682
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807><datestamp>2022-11-17T13:00:19.4048256</datestamp><bib-version>v2</bib-version><id>60682</id><entry>2022-07-29</entry><title>System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis</title><swanseaauthors><author><sid>e31e47c578b2a6a39949aa7f149f4cf9</sid><ORCID>0000-0002-5242-7693</ORCID><firstname>Alan</firstname><surname>Dix</surname><name>Alan Dix</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2022-07-29</date><deptcode>SCS</deptcode><abstract>Background:The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS scale was not specifically designed to evaluate mobile apps, or indeed Digital Health Apps (DHAs).Objective:The objective of this study is to examine whether the widely used SUS distribution for benchmarking (mean of 68 and standard deviation of 12.5) can be used to reliably assess the usability of DHAs.Methods:A search of the literature was performed using ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language was used to model the DHA SUS distribution, with a one-sample t-test used to compare this distribution with the standard SUS distribution.Results:The mean SUS score when all the collected apps were included was 76.64&#xB1;15.12 (mean &#xB1; standard deviation), however this distribution exhibited asymmetrical skewness (-0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for &#x2018;physical activity&#x2019; apps was 83.28&#xB1;12.39 and was driving the skewness. Hence, the mean SUS score for all collected apps, excluding &#x2018;physical activity&#x2019; apps, was 68.05 &#xB1; 14.05. A one-sample t-test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98).Conclusions:This study concludes that SUS and the widely accepted benchmark of a mean SUS score of 68&#xB1;12.5 is suitable for evaluating the usability of DHAs.</abstract><type>Journal Article</type><journal>JMIR mHealth and uHealth</journal><volume>10</volume><journalNumber>8</journalNumber><paginationStart>e37290</paginationStart><paginationEnd/><publisher>JMIR Publications Inc.</publisher><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint/><issnElectronic>2291-5222</issnElectronic><keywords>mHealth SUS scores meta-analysis; SUS for digital health; digital health apps usability; mHealth usability; SUS meta-analysis; mHealth; mobile app; mobile health; digital health; System Usability Scale</keywords><publishedDay>18</publishedDay><publishedMonth>8</publishedMonth><publishedYear>2022</publishedYear><publishedDate>2022-08-18</publishedDate><doi>10.2196/37290</doi><url/><notes/><college>COLLEGE NANME</college><department>Computer Science</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>SCS</DepartmentCode><institution>Swansea University</institution><apcterm/><funders/><projectreference/><lastEdited>2022-11-17T13:00:19.4048256</lastEdited><Created>2022-07-29T17:32:52.3234527</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Maciej</firstname><surname>Hyzy</surname><orcid>0000-0003-0791-8976</orcid><order>1</order></author><author><firstname>Raymond</firstname><surname>Bond</surname><orcid>0000-0002-1078-2232</orcid><order>2</order></author><author><firstname>Maurice</firstname><surname>Mulvenna</surname><orcid>0000-0002-1554-0785</orcid><order>3</order></author><author><firstname>Lu</firstname><surname>Bai</surname><orcid>0000-0003-1242-5412</orcid><order>4</order></author><author><firstname>Alan</firstname><surname>Dix</surname><orcid>0000-0002-5242-7693</orcid><order>5</order></author><author><firstname>Simon</firstname><surname>Leigh</surname><orcid>0000-0002-6843-6447</orcid><order>6</order></author><author><firstname>Sophie</firstname><surname>Hunt</surname><orcid>0000-0001-9515-6582</orcid><order>7</order></author></authors><documents><document><filename>60682__25329__a76850ee85f341c2a76a0206fc588415.pdf</filename><originalFilename>60682.VOR.pdf</originalFilename><uploaded>2022-10-06T14:03:59.7686998</uploaded><type>Output</type><contentLength>376612</contentLength><contentType>application/pdf</contentType><version>Version of Record</version><cronfaStatus>true</cronfaStatus><documentNotes>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work.</documentNotes><copyrightCorrect>true</copyrightCorrect><language>eng</language><licence>https://creativecommons.org/licenses/by/4.0/</licence></document></documents><OutputDurs/></rfc1807>
spelling 2022-11-17T13:00:19.4048256 v2 60682 2022-07-29 System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis e31e47c578b2a6a39949aa7f149f4cf9 0000-0002-5242-7693 Alan Dix Alan Dix true false 2022-07-29 SCS Background:The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS scale was not specifically designed to evaluate mobile apps, or indeed Digital Health Apps (DHAs).Objective:The objective of this study is to examine whether the widely used SUS distribution for benchmarking (mean of 68 and standard deviation of 12.5) can be used to reliably assess the usability of DHAs.Methods:A search of the literature was performed using ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language was used to model the DHA SUS distribution, with a one-sample t-test used to compare this distribution with the standard SUS distribution.Results:The mean SUS score when all the collected apps were included was 76.64±15.12 (mean ± standard deviation), however this distribution exhibited asymmetrical skewness (-0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for ‘physical activity’ apps was 83.28±12.39 and was driving the skewness. Hence, the mean SUS score for all collected apps, excluding ‘physical activity’ apps, was 68.05 ± 14.05. A one-sample t-test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98).Conclusions:This study concludes that SUS and the widely accepted benchmark of a mean SUS score of 68±12.5 is suitable for evaluating the usability of DHAs. Journal Article JMIR mHealth and uHealth 10 8 e37290 JMIR Publications Inc. 2291-5222 mHealth SUS scores meta-analysis; SUS for digital health; digital health apps usability; mHealth usability; SUS meta-analysis; mHealth; mobile app; mobile health; digital health; System Usability Scale 18 8 2022 2022-08-18 10.2196/37290 COLLEGE NANME Computer Science COLLEGE CODE SCS Swansea University 2022-11-17T13:00:19.4048256 2022-07-29T17:32:52.3234527 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Maciej Hyzy 0000-0003-0791-8976 1 Raymond Bond 0000-0002-1078-2232 2 Maurice Mulvenna 0000-0002-1554-0785 3 Lu Bai 0000-0003-1242-5412 4 Alan Dix 0000-0002-5242-7693 5 Simon Leigh 0000-0002-6843-6447 6 Sophie Hunt 0000-0001-9515-6582 7 60682__25329__a76850ee85f341c2a76a0206fc588415.pdf 60682.VOR.pdf 2022-10-06T14:03:59.7686998 Output 376612 application/pdf Version of Record true This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work. true eng https://creativecommons.org/licenses/by/4.0/
title System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
spellingShingle System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
Alan Dix
title_short System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
title_full System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
title_fullStr System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
title_full_unstemmed System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
title_sort System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
author_id_str_mv e31e47c578b2a6a39949aa7f149f4cf9
author_id_fullname_str_mv e31e47c578b2a6a39949aa7f149f4cf9_***_Alan Dix
author Alan Dix
author2 Maciej Hyzy
Raymond Bond
Maurice Mulvenna
Lu Bai
Alan Dix
Simon Leigh
Sophie Hunt
format Journal article
container_title JMIR mHealth and uHealth
container_volume 10
container_issue 8
container_start_page e37290
publishDate 2022
institution Swansea University
issn 2291-5222
doi_str_mv 10.2196/37290
publisher JMIR Publications Inc.
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science
document_store_str 1
active_str 0
description Background:The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS scale was not specifically designed to evaluate mobile apps, or indeed Digital Health Apps (DHAs).Objective:The objective of this study is to examine whether the widely used SUS distribution for benchmarking (mean of 68 and standard deviation of 12.5) can be used to reliably assess the usability of DHAs.Methods:A search of the literature was performed using ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language was used to model the DHA SUS distribution, with a one-sample t-test used to compare this distribution with the standard SUS distribution.Results:The mean SUS score when all the collected apps were included was 76.64±15.12 (mean ± standard deviation), however this distribution exhibited asymmetrical skewness (-0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for ‘physical activity’ apps was 83.28±12.39 and was driving the skewness. Hence, the mean SUS score for all collected apps, excluding ‘physical activity’ apps, was 68.05 ± 14.05. A one-sample t-test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98).Conclusions:This study concludes that SUS and the widely accepted benchmark of a mean SUS score of 68±12.5 is suitable for evaluating the usability of DHAs.
published_date 2022-08-18T04:18:59Z
_version_ 1763754261600010240
score 11.03559

Similar Items