Abstract

Several research articles published in the realm of Computer Assisted Language Learning (CALL) have reported evidence of the benefits of multimodal annotations, i.e. the provision of pictorial as well as verbal clarifications, for vocabulary uptake from reading. Almost invariably, these publications account for the observed benefits with reference to Paivio's "Dual Coding Theory," suggesting it is the visual illustration of word meaning that enhances the quality of processing and hence makes new words more memorable. In this discussion article, we explore the possibility that it is not necessarily the multimodality "per se" that accounts for the reported benefits. Instead, we argue that the provision of multimodal annotations is one of several possible means of inviting more and/or longer attention to the annotations--with amounts of attention given to words being a significant predictor of their retention in memory. After reviewing the available research on the subject and questioning whether invoking Paivio's "Dual Coding Theory" is an optimal account for reported findings, we report an eye-tracking study the results of which are consistent with the alternative thesis that the advantage of multimodal glosses for word learning lies with the greater quantity of attention these glosses attract in comparison with single-mode glosses. We conclude with a call for further research on combinations and sequences of annotation types, regardless of multimodality, as ways of promoting vocabulary uptake from reading.

Citation

Boers, F., Warren, P., Grimshaw, G. & Siyanova-Chanturia, A. (2017). On the Benefits of Multimodal Annotations for Vocabulary Uptake from Reading. Computer Assisted Language Learning, 30(7), 709-725. Retrieved June 10, 2023 from https://www.learntechlib.org/p/188778/.

This record was imported from ERIC on January 9, 2019. [Original Record]

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.

Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.

Keywords

• adults
• Comparative Analysis
• Computer Assisted Instruction
• Documentation
• English (Second Language)
• Eye Movements
• Foreign Countries
• Foreign Students
• Multimedia Instruction
• reading comprehension
• Recall (Psychology)
• Retention (Psychology)
• Second Language Instruction
• second language learning
• Semantics
• vocabulary