Conference Paper/Proceeding/Abstract 474 views 108 downloads
“You, Move There!”: Investigating the Impact of Feedback on Voice Control in Virtual Environments
,
Benjamin R. Cowan,
Julie R. Williamson
CUI 2021 - 3rd Conference on Conversational User Interfaces
Swansea University Author:
Leigh Clark
-
PDF | Version of Record
© 2021 Copyright held by the owner/author(s). This work is licensed under a Creative Commons Attribution International 4.0 License
Download (2.29MB)
DOI (Published version): 10.1145/3469595.3469609
Abstract
Current virtual environment (VEs) input techniques often overlook speech as a useful control modality. Speech could improve interaction in multimodal VEs by enabling users to address objects, locations, and agents, yet research on how to design effective speech for VEs is limited. Our paper investig...
| Published in: | CUI 2021 - 3rd Conference on Conversational User Interfaces |
|---|---|
| ISBN: | 978-1-4503-8998-3 |
| Published: |
New York, NY, USA
ACM
2021
|
| URI: | https://cronfa.swan.ac.uk/Record/cronfa57576 |
| Abstract: |
Current virtual environment (VEs) input techniques often overlook speech as a useful control modality. Speech could improve interaction in multimodal VEs by enabling users to address objects, locations, and agents, yet research on how to design effective speech for VEs is limited. Our paper investigates the effect of agent feedback on speech VE experiences. Through a lab study, users commanded agents to navigate a VE, receiving either auditory, visual or behavioural feedback. Based on a post interaction semi-structured interview, we find that the type of feedback given by agents is critical to user experience. Specifically auditory mechanisms are preferred, allowing users to engage with other modalities seamlessly during interaction. Although command-like utterances were frequently used, it was perceived as contextually appropriate, ensuring users were understood. Many also found it difficult to discover speech-based functionality. Drawing on these, we discuss key challenges for designing speech input for VEs. |
|---|---|
| Keywords: |
Virtual Environments, Speech Input, Gesture Input |
| College: |
Faculty of Science and Engineering |