Implementation of an electronic Objective Structured Clinical Exam for assessing practical skills in pre-professional physiotherapy and occupational therapy programs: Examiner and course coordinator perspectives
ARTICLE
Suzanne Snodgrass, Samantha Ashby, Darren Rivett, The University of Newcastle ; Trevor Russell, The University of Queensland
Australasian Journal of Educational Technology Volume 30, Number 2, ISSN 0814-673X Publisher: Australasian Society for Computers in Learning in Tertiary Education
Abstract
Assessment of practical clinical skills is essential in the health fields. Objective Structured Clinical Exams (OSCEs), where examiners assess students performing clinical procedures on simulated patients (actors), are central to the evaluation of practical skills. However, traditional OSCEs require considerable time-investment to administer, and providing timely, individualised student feedback is difficult. To address these issues, an electronic OSCE (eOSCE) was developed utilising the iPad and specialised software. The eOSCE was trialled in four courses within two entry-level rehabilitative pre-professional programs at two universities, physiotherapy and occupational therapy. Evaluation consisted of student surveys (n = 206), eight student focus groups (n = 25), examiner surveys (n = 25) and interviews with course coordinators (n = 3). This paper describes the administration of the eOSCE and reports on its evaluation from the academic’s perspective. A majority of examiners (68%) preferred the eOSCE over traditional paper-based OSCEs, primarily because of the consistency and promptness of student feedback. The advantages academics cited were equitable student feedback and post-examination administrative time-savings. Disadvantages of the eOSCE were the pre-examination preparation required and challenges for examiners not comfortable using technology. Overall, the key benefits of the eOSCE were the automated, immediate individualised student feedback and a time saving in OSCE administration.
Citation
Snodgrass, S., Ashby, S., Rivett, D. & Russell, T. (2014). Implementation of an electronic Objective Structured Clinical Exam for assessing practical skills in pre-professional physiotherapy and occupational therapy programs: Examiner and course coordinator perspectives. Australasian Journal of Educational Technology, 30(2),. Australasian Society for Computers in Learning in Tertiary Education. Retrieved March 28, 2024 from https://www.learntechlib.org/p/148101/.
References
View References & Citations Map- Bhatt, V.R., Giri, S., & Koirala, S. (2010). Health workforce shortage: A global crisis. The Internet Journal of World Health and Societal Politics, 7(1).
- Boud, D., & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment& Evaluation in Higher Education, 31(4), 399-413.
- Dearnley, C., Taylor, J., Hennessy, S., Parks, M., Coates, C., Haigh, J., Fairhall, J., Riley, K., & Dransfield, M. (2009). Using mobile technologies for assessment and learning in practice settings: Outcomes of five case studies. International Journal on E-Learning, 8(2), 193-207.
- Fields, H.W., Rowland, M.L., Vig, K.W., & Huja, S.S. (2007). Objective structured clinical examination use in advanced orthodontic dental education. American Journal of Orthodontics and Dentofacial Orthopedics, 131(5), 656-663.
- Gijbels, D., Coertjens, L., Vanthournout, G., Struyf, E., & Van Petegram, P. (2009). Changing students' approaches to learning: A two-year study within a university teacher training course. Educational Studies, 35(5), 503-513.
- Hawker, J.A., Walker, K.Z., Barrington, V., & Andrianopoulos, N. (2010). Measuring the success of an objective structured clinical examination for dietetic students. Journal of Human Nutrition and Dietetics, 23(3), 212-216.
- Health Workforce Australia. (2011). National Health Workforce Innovation and Reform Strategic Framework for Action 2011–2015. (978-0-9871920-0-4). Adelaide: Health Workforce Australia Retrieved from http://www.hwa.gov.au/sites/uploads/hwa-wir-strategic-framework-for-action201110.pdf
- Kneebone, R., Nestel, D., Ratnasothy, J., Kidd, J., & Darzi, A. (2003). The use of handheld computers in scenario-based procedural assessments. Medical Teacher, 25(6), 632-642.
- McIlroy, J.H. (2000). The impact of an alternative approach to computing station cut scores in an OSCE. Academic Medicine, 75(10 Suppl), S18-20.
- Nackman, G.B., Griggs, M., & Galt, J. (2006). Implementation of a novel web-based objective structured clinical evaluation. Surgery, 140, 206-211.
- Pinto, A., Selvaggi, S., Sicignano, G., Vollono, E., Iervolino, L., Amato, F., Molinari, A., & Grassi, R. (2008). E-learning tools for education: regulatory aspects, current applications in radiology and future prospects. La radiologica medica, 113(1), 144-157.
- Renaud, G., & Jalali, A. (2011). Helping dyslexic medical students pass their OSCE exams. Elearn magazine, 1-3.
- Ross, M., Carroll, G., Knight, J., Chamberlain, M., Fothergill-Bourbonnais, F., & Linton, J. (1988). Using the OSCE to measure clinical skills performance in nursing. Journal of Advanced Nursing, 13, 45-56.
- Rushforth, H.E. (2007). Objective structured clinical examination (OSCE): Review of literature and implications for nursing education. Nurse Education Today, 27(5), 481-490.
- Saldana, J. (2009). The coding manual for qualitative researchers. Thousand Oaks, California, US: SAGE Publications Ltd.
- Sturpe, D.A. (2010). Objective structured clinical examinations in doctor of pharmacy programs in the United States. The American Journal of Pharmaceutical Education, 74(8), 148.
- Torre, D.M., Treat, R., Durning, S., & Elnicki, D.M. (2011). Comparing PDA-and paper-based evaluation of the clinical skills of third-year students. Wisconsin Medical Journal, 110(1), 9-13.
- Treadwell, I. (2006). The usability of personal digital assistants (PDAs) for assessment of practical performance. Medical Education, 40(9), 855-861.
- Turner, J.L., & Dankoski, M.E. (2008). Objective structured clinical exams: a critical review. Family Medicine, 40(8), 574-578.
- Van den Berk, I.A., van de Ridder, J.M., & Van Schaik, J.P. (2011). Radiology as part of an objective structured clinical examination on clinical skills. European Journal of Radiololgy, 78(3), 363-367.
- Van Schoor, A.N., Navsa, N., Meiring, J.H., Treadwell, I., Bosman, M.C., & Greyling, L.M. (2006). Perspectives on the use of PDAs as assessment tools. Clinical Teacher, 3(3), 170-174.
- Wilkinson, T.J., Frampton, C.M., Thompson-Fawcett, M., & Egan, T. (2003). Objectivity in objective structured clinical examinations: Checklists are no substitute for examiner commitment. Academic Medicine, 78(2), 219-223.
- Yuen, S.C.-Y., & Yuen, P.K. (2003). PDAs as educational power tools. Tech Directions, 62(9), 14.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to References