The development and evaluation of a software prototype for computer-adaptive testing
ARTICLE
M. Lilley, T. Barker, C. Britton
Computers & Education Volume 43, Number 1, ISSN 0360-1315 Publisher: Elsevier Ltd
Abstract
This paper presents ongoing research at the University of Hertfordshire on the use of computer-adaptive tests (CATs) in Higher Education. A software prototype based on Item Response Theory has been developed and is described here. This application was designed to estimate the level of proficiency in English for those students whose first language is not English. Academic staff and students evaluated the prototype introduced here and we summarise their attitude to the user interface and to pedagogical aspects of the prototype. We provide evidence that learners are not disadvantaged by the CAT approach, based on a comparison of performance between CAT and computer-based tests. A group of international students also took part in a focus group session after using the software. During this session, students discussed issues related to computer-adaptive tests, ranging from their perception that very easy tests are “meaningless” to their insights into the fairness of such computer-assisted assessments.In addition, this paper outlines how our current work will be developed further by implementing multimedia resources, developing more subjective tests and adding a stop condition associated with the calculation of standard error. Finally, the benefits and potential limitations of this method of assessment are also presented here.
Citation
Lilley, M., Barker, T. & Britton, C. (2004). The development and evaluation of a software prototype for computer-adaptive testing. Computers & Education, 43(1), 109-123. Elsevier Ltd. Retrieved March 27, 2024 from https://www.learntechlib.org/p/66799/.
This record was imported from Computers & Education on January 30, 2019. Computers & Education is a publication of Elsevier.
Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.compedu.2003.12.008Keywords
- Adaptive Testing
- Applications in subject areas
- Computer Assisted Testing
- Computer Attitudes
- Computer Software Evaluation
- English (Second Language)
- Error of Measurement
- Evaluation of CAL systems
- Foreign Countries
- higher education
- Human–computer interface
- Item response theory
- Language Proficiency
- Man Machine Systems
- Multimedia Materials
- pedagogical issues
Cited By
View References & Citations Map-
Applying adaptive variables in computerised adaptive testing
Evangelos Triantafillou, Elissavet Georgiadou, Anastasios Economides & Anastasios Economides
Australasian Journal of Educational Technology Vol. 23, No. 3 (Jan 01, 2007)
-
An Automated Feedback System Based on Adaptive Testing: Extending the Model
Trevor Barker, University of Hertfordshire
International Journal of Emerging Technologies in Learning (iJET) Vol. 5, No. 2 (Jun 05, 2010) pp. 11–14
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.