Title: Development of a dual-modal information presentation of sequential relationship

Authors: Shuang Xu, Xiaowen Fang, Susy Chan

Addresses: Human Factors Research & Design, Consumer Experience Design, Motorola Inc., 600 North US Highway 45, Libertyville, IL 60048, USA. ' College of Computing and Digital Media, DePaul University, 243 S. Wabash Avenue, Chicago, IL 60614, USA. ' College of Computing and Digital Media, DePaul University, 243 S. Wabash Avenue, Chicago, IL 60614, USA

Abstract: This study focuses on how to design a visual-auditory presentation to minimise the interference in information processing between modality channels; and to improve the effectiveness of mental integration of multimodal information. A method was proposed to convert textual information describing sequential relationships into a |graphics + voice| presentation. It was hypothesised that this dual-modal presentation would result in superior comprehension performance and user satisfaction as compared with the pure textual display. Findings of our experiment fully supported the hypothesis and would benefit interface design of mobile applications by alleviating the overabundance of information output in the visual channel.

Keywords: human attention; information presentation; multimodal interfaces; mobile learning; m-learning; working memory; sequential relationships; information processing; mental integration; visual-auditory presentation; voice; graphics; comprehension performance; user satisfaction; interface design.

DOI: 10.1504/IJMLO.2009.026310

International Journal of Mobile Learning and Organisation, 2009 Vol.3 No.3, pp.223 - 242

Published online: 06 Jun 2009 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article