Effectiveness of Subjective Evaluation of Basic Computer Literacy at a University in Japan
Masahiro Nagai, Takeshi Kitazawa, Hiroshi Tachibana, Jun Ueno, Tokyo Metropolitan University, Japan ; Hiroshi Kato, National Institute of Multimedia Education, Japan
Society for Information Technology & Teacher Education International Conference, in Las Vegas, Nevada, USA ISBN 978-1-880094-64-8 Publisher: Association for the Advancement of Computing in Education (AACE), Chesapeake, VA
We conducted a readiness survey on information technology education for students who matriculated in a university in 2006 and 2007. Related researches state that there is no relationship between subjective and objective evaluations; however, in 2006, we conducted only a subjective evaluation, using questionnaires, to determine the students' levels of readiness. In 2007, we surveyed the two methods of evaluation to clarify the relationship between them. Consequently, we found a weak correlation between the methods. Moreover, the total points on the problems in the objective test, which showed a high discrimination, tended to have a stronger correlation with the subjective evaluation than the points on the problems that showed a low discrimination. Therefore, subjective evaluation is neither unreliable nor invalid. It is essential to consider the questionnaire items and problems and discuss the learning contents and teaching methods, based on the results of the subjective evaluation.
Nagai, M., Kitazawa, T., Tachibana, H., Ueno, J. & Kato, H. (2008). Effectiveness of Subjective Evaluation of Basic Computer Literacy at a University in Japan. In K. McFerrin, R. Weber, R. Carlsen & D. Willis (Eds.), Proceedings of SITE 2008--Society for Information Technology & Teacher Education International Conference (pp. 3874-3881). Las Vegas, Nevada, USA: Association for the Advancement of Computing in Education (AACE).