You are here:

An Investigation of Tradeoffs between Techniques to Support User-centred Evaluations of Adaptive Game-based Learning Systems
PROCEEDING

, , Dublin City University, Ireland ; , Adapt Centre, Trinity College Dublin, Ireland

Global Learn, in Limerick, Ireland Publisher: Association for the Advancement of Computing in Education (AACE)

Full Text

Abstract

This paper presents the results of an investigation of existing tradeoffs between evaluation techniques (methods, criteria and metrics) to support user-centred evaluations of adaptive game-based learning systems developed from 2000 to date. Adaptive game-based systems are developed in technology-enhanced learning environments which increasingly offer possibilities for adapting and personalising learning activities and experiences. Evaluation of these systems is a significant but very complex area of research in itself, depending on the aspect of adaptivity that needs to be evaluated. Several evaluation techniques need to be combined and executed differently in order to produce good results. A review of such systems was conducted and the results presented. A review of these systems was also conducted.

Citation

Mulwa, C., Fitzpatrick, D. & Wade, V. (2016). An Investigation of Tradeoffs between Techniques to Support User-centred Evaluations of Adaptive Game-based Learning Systems. In Proceedings of Global Learn-Global Conference on Learning and Technology (pp. 252-261). Limerick, Ireland: Association for the Advancement of Computing in Education (AACE). Retrieved December 1, 2023 from .

© 2016 Association for the Advancement of Computing in Education (AACE)

References

View References & Citations Map
  1. Brusilovsky, P. (1996). Methods and techniques of adaptive hypermedia. User modeling and user-adapted interaction, 6(2-3), 87-129.
  2. Brusilovsky, P. (2001). Adaptive hypermedia. User modeling and user-adapted interaction, 11(1-2), 87-110.
  3. Conlan, O., Hampson, C., Peirce, N., & Kickmeier-Rust, M. (2009). Realtime knowledge space skill assessment for personalized digital educational games. Paper presented at the Advanced Learning Technologies, 2009. ICALT 2009. Ninth IEEE International Conference on.
  4. Conlan, O., & Wade, V. (2004). Evaluation of APeLS – An Adaptive eLearning Service Based on the Multi-model, Metadata-Driven Approach. Paper presented at the Adaptive Hypermedia and Adaptive Web-Based Systems, AH2004.
  5. Csikszentmihalyi M. (1990). Flow: The psychology of optimal experience. NY: New York: Harper and Row.,. De Bra, P., Aerts, A., Berden, B., De Lange, B., Rousseau, B., Santic, T., et al. (2003). AHA! The adaptive hypermedia architecture. Paper presented at the Proceedings of the fourteenth ACM conference on Hypertext and hypermedia.
  6. De Jong, M., & Schellens, P. (1997). Reader-Focused Text Evaluation. An Overview of Goals and Methods. Journal of Business and Technical Communication, 11(4), 402-432.
  7. Gena, C. (2005). Methods and techniques for the evaluation of user-adaptive systems. The knowledge engineer review, 20(1), 1-37, United Kingdom: CambridgeUniversity Press.
  8. Gena, C. (2005). Methods and techniques for the evaluation of user-adaptive systems, The Knowledge Engineering Review. 20(1), 1-37.
  9. Gupta, A., & Grover, P. (2004). Proposed evaluation framework for adaptive hypermedia systems. Johnson, W.L., Wang, N., & Wu, S., (2007). Experience with serious games for learning foreign languages and cultures. Paper presented at the SimTecT Conference.
  10. Koper, R., & Olivier, B. (2003). Representing the learning design of units of learning. Educational Technology& Society 7 97-111.
  11. Malone, T.W. (1981). Toward a theory of intrinsically motivating instruction. Cognitive science, 5(4), 333-369.
  12. Masthoff, J. (2006). The user as wizard: A method for early involvement in the design and evaluation of adaptive systems.
  13. Merrill, M.D. (2002). First principles of instruction. Educational technology research and development, 50 (3), 43-59.
  14. Mitchell, A., & Savill-Smith, C. (2004). The use of computer and videogames for learning: A review of the literature. Learning and Skills Development Agency, London.
  15. Nielsen, J. (1993). Usability Engineering: Boston: MA: Academic Press.
  16. Paramythis, A., Weibelzahl, S., & Masthoff, J. (2010). Layered evaluation of interactive adaptive systems: framework and formative methods. User Modeling and User-Adapted Interaction, 1-71.
  17. Peirce, N., Conlan, O., & Wade, V. (2008). Adaptive educational games: Providing non-invasive personalised learning experiences. Paper presented at the Digital Games and Intelligent Toys Based Education, 2008-260-Global Learn 2016-Limerick, Ireland, April 28-29, 2016
  18. Pivec, M. (2007). Editorial: Play and learn: potentials of game ‐based learning. British Journal of Educational Technology, 38(3), 387-393.
  19. Raibulet, C., & Masciadri, L. (2009). Evaluation of dynamic adaptivity through metrics: an achievable target?
  20. Rieber, L.P. (1996). Seriously considering play: Designing interactive learning environments based on the blending of microworlds, simulations, and games. Educational technology research and development, 44(2), 43-58.
  21. Santos Jr, E., Zhao, Q., Nguyen, H., & Wang, H. (2005). Impacts of User Modeling on Personalization of Information Retrieval: An evaluation with human intelligence analysts.
  22. Santos, O.C. (2008). A recommender system to provide adaptive and inclusive standard-based support along the elearning lifecycle, In the Proceedings of the 2008 ACM Conference on Recommender Systems Lausanne, Switzerland.
  23. Scholtz, J. (2004). Usability evaluation. National Institute of Standards and Technology.
  24. Schulmeister, R. (2004). Didaktisches Design aus hochschuldidaktischer Sicht–ein Plädoyer für offene Lernsituationen. Didaktik und neue Medien. Konzepte und Anwendungen in der Hochschule, 21, 19-49.
  25. Van Eck, R. (2006). Digital game-based learning: It's not just the digital natives who are restless. EDUCAUSE review, 41(2), 16.
  26. Van Eck, R. (2007). Building artificially intelligent learning games. Games and simulations in online learning: Research and development frameworks, 271-307.
  27. Van Velsen, L., Vander Geest, T., Klaasen, R., & Steehounder, M. (2008). User-centered evaluation of adaptive and adaptable systems: a literature review. The Knowledge Engineering Review, 23(03), 261-281.

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References

Also Read

Related Collections