No Cover Image

Journal article 729 views 107 downloads

System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis

Maciej Hyzy Orcid Logo, Raymond Bond Orcid Logo, Maurice Mulvenna Orcid Logo, Lu Bai Orcid Logo, Alan Dix Orcid Logo, Simon Leigh Orcid Logo, Sophie Hunt Orcid Logo

JMIR mHealth and uHealth, Volume: 10, Issue: 8, Start page: e37290

Swansea University Author: Alan Dix Orcid Logo

  • 60682.VOR.pdf

    PDF | Version of Record

    This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work.

    Download (367.79KB)

Check full text

DOI (Published version): 10.2196/37290

Abstract

Background:The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS scale was not specifically designed to evaluate mobile apps, or indeed Digital Health Apps (DHAs).Objective:The objective of this s...

Full description

Published in: JMIR mHealth and uHealth
ISSN: 2291-5222
Published: JMIR Publications Inc. 2022
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa60682
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: Background:The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS scale was not specifically designed to evaluate mobile apps, or indeed Digital Health Apps (DHAs).Objective:The objective of this study is to examine whether the widely used SUS distribution for benchmarking (mean of 68 and standard deviation of 12.5) can be used to reliably assess the usability of DHAs.Methods:A search of the literature was performed using ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language was used to model the DHA SUS distribution, with a one-sample t-test used to compare this distribution with the standard SUS distribution.Results:The mean SUS score when all the collected apps were included was 76.64±15.12 (mean ± standard deviation), however this distribution exhibited asymmetrical skewness (-0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for ‘physical activity’ apps was 83.28±12.39 and was driving the skewness. Hence, the mean SUS score for all collected apps, excluding ‘physical activity’ apps, was 68.05 ± 14.05. A one-sample t-test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98).Conclusions:This study concludes that SUS and the widely accepted benchmark of a mean SUS score of 68±12.5 is suitable for evaluating the usability of DHAs.
Keywords: mHealth SUS scores meta-analysis; SUS for digital health; digital health apps usability; mHealth usability; SUS meta-analysis; mHealth; mobile app; mobile health; digital health; System Usability Scale
College: Faculty of Science and Engineering
Issue: 8
Start Page: e37290