Designing user interfaces with gestures and sound: Towards the performance and appeal of voice mail browsing Online publication date: Mon, 04-Sep-2006
by Marco C. Rozendaal, David V. Keyson
J. of Design Research (JDR), Vol. 5, No. 1, 2006
Abstract: This paper explores the use of sound and gestures within a tangible user interface, towards influencing the performance and appeal of browsing through a voice mail collection. Three browsers were developed, in which speech and non-speech sounds were projected in a sound-scape above a tangible interface. For each of the browsers, users were given the task of locating voice mail messages. Search behaviour in terms of gestures, task time, and errors, were recorded and categorised. Users' experience was measured in terms of appeal, consisting of hedonic and ergonomic qualities. Results showed that users' explorative behaviour changed, depending on the specific type of browser. Subjects were observed to utilise non-speech sound cues effectively in searching for target voice mail messages. Subjective results showed that ergonomic and hedonic qualities of appeal were found to interact in an averaging way, such that overall appeal was similar across conditions. Implications towards designing multimodal interfaces are discussed.
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.Complimentary Subscribers, Editors or Members of the Editorial Board of the J. of Design Research (JDR):
Login with your Inderscience username and password:
Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.
If you still need assistance, please email subs@inderscience.com
Our Blog 
Follow us on Twitter 
Visit us on Facebook