You are here:

The Use of Sonification in Synthetic Voice Messages

, San Jose State University, United States ; , University of Kansas, United States

EdMedia + Innovate Learning, in Vancouver, Canada ISBN 978-1-880094-62-4 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC


This paper reports the findings of a research study that examined the use of sonification in synthetic voice messages as an aid to listening task performance. Part one of the study examined five dimensions of user satisfaction with sonification in synthetic voice audio messages in terms of recruiting attention, aiding listening, helping to remember details, aesthetic appeal, and overall valuation. Overall mean response ratings for messages with sonification were higher than messages without sonification across all five dimensions. In part two of the study an experiment was conducted that measured listening task performance in terms of extra recall effects across four listening tasks. The results of this experiment indicated that the presence of sonification in messages may improve listening task performance in competitive acoustic environments. Future applications include using non-speech audio cues as a means to improve synthetic natural-language speech intelligibility and augment other sensory modalities for human-machine interface.


Isaacson, R. & Aust, R. (2007). The Use of Sonification in Synthetic Voice Messages. In C. Montgomerie & J. Seale (Eds.), Proceedings of ED-MEDIA 2007--World Conference on Educational Multimedia, Hypermedia & Telecommunications (pp. 957-965). Vancouver, Canada: Association for the Advancement of Computing in Education (AACE). Retrieved February 28, 2020 from .



View References & Citations Map

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References