You are here:

Statistical semi-supervised system for grading multiple peer-reviewed open-ended works

, , ,

Computers & Education Volume 126, Number 1, ISSN 0360-1315 Publisher: Elsevier Ltd


In the education context, open-ended works generally entail a series of benefits as the possibility of develop original ideas and a more productive learning process to the student rather than closed-answer activities. Nevertheless, such works suppose a significant correction workload to the teacher in contrast to the latter ones that can be self-corrected. Furthermore, such workload turns to be intractable with large groups of students. In order to maintain the advantages of open-ended works with a reasonable amount of correction effort, this article proposes a novel methodology: students perform the corrections using a rubric (closed Likert scale) as a guideline in a peer-review fashion; then, their markings are automatically analyzed with statistical tools to detect possible biased scorings; finally, in the event the statistical analysis detects a biased case, the teacher is required to intervene to manually correct the assignment. This methodology has been tested on two different assignments with two heterogeneous groups of people to assess the robustness and reliability of the proposal. As a result, we obtain values over 95% in the confidence of the intra-class correlation test (ICC) between the grades computed by our proposal and those directly resulting from the manual correction of the teacher. These figures confirm that the evaluation obtained with the proposed methodology is statistically similar to that of the manual correction of the teacher with a remarkable decrease in terms of effort.


Rico-Juan, J.R., Gallego, A.J., Valero-Mas, J.J. & Calvo-Zaragoza, J. (2018). Statistical semi-supervised system for grading multiple peer-reviewed open-ended works. Computers & Education, 126(1), 264-282. Elsevier Ltd. Retrieved June 2, 2020 from .

This record was imported from Computers & Education on January 29, 2019. Computers & Education is a publication of Elsevier.

Full text is availabe on Science Direct: