Situation-Aware, User-Centric Multimodality for Automotive

Abstract:
This article offers a brief overview of multimodal (speech, touch, gaze, etc.) input theory as it pertains to common invehicle tasks and devices. After a brief introduction, we walk through a sample multimodal interaction, detailing the steps involved and how information necessary to the interaction can be obtained by combining input modes in various ways. We also discuss how contemporary in-vehicle systems take advantage of multimodality (or fail to do so), and how the capabilities of such systems might be broadened in the future via clever multimodal input mechanisms.