You are here:

Pragmatic Meta-Analytic Studies: Learning the Lessons from Naturalistic Evaluations of Multiple Cases

, ,

Association for Learning Technology Journal Volume 16, Number 2, ISSN 0968-7769


This paper explores the concept of pragmatic meta-analytic studies in eLearning. Much educational technology literature focuses on developers and teachers describing and reflecting on their experiences. Few connections are made between these experiential "stories". The data set is fragmented and offers few generalisable lessons. The field needs guidelines about what can be learnt from such single-case reports. The pragmatic meta-analytic studies described in this paper have two common aspects: (1) the cases are related in some way, and (2) the data are authentic, that is, the evaluations have followed a naturalistic approach. We suggest that examining a number of such cases is best done by a mixed-methods approach with an emphasis on qualitative strategies. In the paper, we overview 63 eLearning cases. Three main meta-analytic strategies were used: (1) meta-analysis of the perception of usefulness across all cases, (2) meta-analysis of recorded benefits and challenges across all cases, and (3) meta-analysis of smaller groups of cases where the learning design and/or use of technology are similar. This study indicated that in Hong Kong the basic and non-interactive eLearning strategies are often valued by students, while their perceptions of interactive strategies that are potentially more beneficial fluctuate. One possible explanation relates to the level of risk that teachers and students are willing to take in venturing into more innovative teaching and learning strategies. (Contains 6 tables and 1 figure.)


Lam, P., McNaught, C. & Cheng, K.F. (2008). Pragmatic Meta-Analytic Studies: Learning the Lessons from Naturalistic Evaluations of Multiple Cases. Association for Learning Technology Journal, 16(2), 61-79. Retrieved August 9, 2022 from .

This record was imported from ERIC on July 1, 2013. [Original Record]

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.

Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.


Cited By

View References & Citations Map

These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact