No Cover Image

Journal article 580 views 473 downloads

Steering the conversation: A linguistic exploration of natural language interactions with a digital assistant during simulated driving

David R. Large, Leigh Clark Orcid Logo, Annie Quandt, Gary Burnett, Lee Skrypchuk

Applied Ergonomics, Volume: 63, Pages: 53 - 61

Swansea University Author: Leigh Clark Orcid Logo

  • JERG-D-16-00728R2.20Large.pdf

    PDF | Accepted Manuscript

    Released under the terms of a Creative Commons Attribution Non-commercial No Derivatives license (CC-BY-NC-ND).

    Download (286.37KB)

Abstract

Given the proliferation of ‘intelligent’ and ‘socially-aware’ digital assistants embodying everyday mobile technology – and the undeniable logic that utilising voice-activated controls and interfaces in cars reduces the visual and manual distraction of interacting with in-vehicle devices – it appear...

Full description

Published in: Applied Ergonomics
ISSN: 0003-6870
Published: Elsevier BV 2017
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa52486
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: Given the proliferation of ‘intelligent’ and ‘socially-aware’ digital assistants embodying everyday mobile technology – and the undeniable logic that utilising voice-activated controls and interfaces in cars reduces the visual and manual distraction of interacting with in-vehicle devices – it appears inevitable that next generation vehicles will be embodied by digital assistants and utilise spoken language as a method of interaction. From a design perspective, defining the language and interaction style that a digital driving assistant should adopt is contingent on the role that they play within the social fabric and context in which they are situated. We therefore conducted a qualitative, Wizard-of-Oz study to explore how drivers might interact linguistically with a natural language digital driving assistant. Twenty-five participants drove for 10 min in a medium-fidelity driving simulator while interacting with a state-of-the-art, high-functioning, conversational digital driving assistant. All exchanges were transcribed and analysed using recognised linguistic techniques, such as discourse and conversation analysis, normally reserved for interpersonal investigation. Language usage patterns demonstrate that interactions with the digital assistant were fundamentally social in nature, with participants affording the assistant equal social status and high-level cognitive processing capability. For example, participants were polite, actively controlled turn-taking during the conversation, and used back-channelling, fillers and hesitation, as they might in human communication. Furthermore, participants expected the digital assistant to understand and process complex requests mitigated with hedging words and expressions, and peppered with vague language and deictic references requiring shared contextual information and mutual understanding. Findings are presented in six themes which emerged during the analysis – formulating responses; turn-taking; back-channelling, fillers and hesitation; vague language; mitigating requests and politeness and praise. The results can be used to inform the design of future in-vehicle natural language systems, in particular to help manage the tension between designing for an engaging dialogue (important for technology acceptance) and designing for an effective dialogue (important to minimise distraction in a driving context).
Keywords: Natural language interface, Digital assistant, Social AIs, DrivingSimulation, Wizard-of-Oz
College: Faculty of Science and Engineering
Start Page: 53
End Page: 61