The Use of Sonification in Synthetic Voice Messages
Robert Isaacson, San Jose State University, United States ; Ron Aust, University of Kansas, United States
EdMedia + Innovate Learning, in Vancouver, Canada ISBN 978-1-880094-62-4 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC
This paper reports the findings of a research study that examined the use of sonification in synthetic voice messages as an aid to listening task performance. Part one of the study examined five dimensions of user satisfaction with sonification in synthetic voice audio messages in terms of recruiting attention, aiding listening, helping to remember details, aesthetic appeal, and overall valuation. Overall mean response ratings for messages with sonification were higher than messages without sonification across all five dimensions. In part two of the study an experiment was conducted that measured listening task performance in terms of extra recall effects across four listening tasks. The results of this experiment indicated that the presence of sonification in messages may improve listening task performance in competitive acoustic environments. Future applications include using non-speech audio cues as a means to improve synthetic natural-language speech intelligibility and augment other sensory modalities for human-machine interface.
Isaacson, R. & Aust, R. (2007). The Use of Sonification in Synthetic Voice Messages. In C. Montgomerie & J. Seale (Eds.), Proceedings of ED-MEDIA 2007--World Conference on Educational Multimedia, Hypermedia & Telecommunications (pp. 957-965). Vancouver, Canada: Association for the Advancement of Computing in Education (AACE).
© 2007 Association for the Advancement of Computing in Education (AACE)