No Cover Image

Conference Paper/Proceeding/Abstract 29 views 6 downloads

“You, Move There!”: Investigating the Impact of Feedback on Voice Control in Virtual Environments / Mitchell Baxter, Anna Bleakley, Justin Edwards, Leigh Clark, Benjamin R. Cowan, Julie R. Williamson

CUI 2021 - 3rd Conference on Conversational User Interfaces

Swansea University Author: Leigh Clark

  • 57576.pdf

    PDF | Version of Record

    © 2021 Copyright held by the owner/author(s). This work is licensed under a Creative Commons Attribution International 4.0 License

    Download (2.29MB)

DOI (Published version): 10.1145/3469595.3469609

Abstract

Current virtual environment (VEs) input techniques often overlook speech as a useful control modality. Speech could improve interaction in multimodal VEs by enabling users to address objects, locations, and agents, yet research on how to design effective speech for VEs is limited. Our paper investig...

Full description

Published in: CUI 2021 - 3rd Conference on Conversational User Interfaces
ISBN: 978-1-4503-8998-3
Published: New York, NY, USA ACM 2021
URI: https://cronfa.swan.ac.uk/Record/cronfa57576
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: Current virtual environment (VEs) input techniques often overlook speech as a useful control modality. Speech could improve interaction in multimodal VEs by enabling users to address objects, locations, and agents, yet research on how to design effective speech for VEs is limited. Our paper investigates the effect of agent feedback on speech VE experiences. Through a lab study, users commanded agents to navigate a VE, receiving either auditory, visual or behavioural feedback. Based on a post interaction semi-structured interview, we find that the type of feedback given by agents is critical to user experience. Specifically auditory mechanisms are preferred, allowing users to engage with other modalities seamlessly during interaction. Although command-like utterances were frequently used, it was perceived as contextually appropriate, ensuring users were understood. Many also found it difficult to discover speech-based functionality. Drawing on these, we discuss key challenges for designing speech input for VEs.
Keywords: Virtual Environments, Speech Input, Gesture Input
College: College of Science