Employing game analytics techniques in the psychometric measurement of game-based assessments with dynamic content ARTICLE
Yasser Jaffal, Dieter Wloka, Universitt Kassel
Journal of e-Learning and Knowledge Society Volume 11, Number 3, ISSN 1826-6223 e-ISSN 1826-6223 Publisher: Italian e-Learning Association
The adaptation Game-Based Assessment (GBA) (Mislevy et al., 2014) has been growing in the last years backed by video games’ capability of offering a task model to assess learners’ complex knowledge. Since the variables generated from such performances are not directly interpretable, assessment frameworks such as Evidence-Centred Design (ECD) came into play (Mislevy & Almond, 2003). In this work we show our initial findings when using game analytics techniques (Saif El-Nasr et al., 2013) such as play metrics to analyse players’ performance in an open world 3D game for traffic education. The results show that play metrics can be used in cases where game has a dynamic user-generated content of unknown structure. Additionally, we discuss how these metrics can form the basis of measuring psychometric principles that ECD uses to evaluate assessments, which are validity, reliability, comparability and fairness (Mislevy & Wilson, 2003).
Jaffal, Y. & Wloka, D. (2015). Employing game analytics techniques in the psychometric measurement of game-based assessments with dynamic content. Journal of e-Learning and Knowledge Society, 11(3),. Italian e-Learning Association.