A Methodological Approach to Evaluate the Effectiveness of Learner-Generated Digital Media (LGDM) Assignments in Science Education.
Jorge Reyna, University of Technology Sydney, Australia ; Jose Hanham, Western Sydney University, Australia ; Peter Meier, University of Technology Sydney, Australia
EdMedia + Innovate Learning, in Amsterdam, Netherlands Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC
Learner-Generated Digital Media (LGDM) has been an essential part of teaching, learning and assessment practices in Higher Education for more than a decade. Notwithstanding, the field is still considered under-theorised, under-researched and in its infancy. Research studies of LGDM have been mainly qualitative, and implementations of LGDM have rarely been underpinned with systematic approaches that take into account factors such as the training needs of students and appropriate rubrics. Empirical findings from research on LDGM have tended to have limited generalisability, due to the majority of studies drawing on relatively small sample sizes. This paper aims to propose a framework, using a longitudinal, mixed-methods approach to examine changes in students’ self-regulation processes overtime and their relationships with individual and group performance on LDGM assignments in a range of science-based subjects. We also intend to capture group contribution data, Learner Management System (LMS) logs and marks attained with the LGDM task. The qualitative components will include open-ended questions, individual structured interviews and focus groups. Methodological triangulation will be used to evaluate the student learning experience with LGDM assignments. The framework appears to be one of the first systematic approaches in the literature to evaluate LGDM as an assessment tool in higher education. Work in progress and research needs are presented.
Reyna, J., Hanham, J. & Meier, P. (2018). A Methodological Approach to Evaluate the Effectiveness of Learner-Generated Digital Media (LGDM) Assignments in Science Education. In T. Bastiaens, J. Van Braak, M. Brown, L. Cantoni, M. Castro, R. Christensen, G. Davidson-Shivers, K. DePryck, M. Ebner, M. Fominykh, C. Fulford, S. Hatzipanagos, G. Knezek, K. Kreijns, G. Marks, E. Sointu, E. Korsgaard Sorensen, J. Viteli, J. Voogt, P. Weber, E. Weippl & O. Zawacki-Richter (Eds.), Proceedings of EdMedia: World Conference on Educational Media and Technology (pp. 303-314). Amsterdam, Netherlands: Association for the Advancement of Computing in Education (AACE). Retrieved February 18, 2019 from https://www.learntechlib.org/primary/p/184211/.
© 2018 Association for the Advancement of Computing in Education (AACE)
- Anderson, J. (2013). Active learning through student film: a case study of cultural geography. Journal of Geography in Higher Education, 37(3), 385-398.
- Anuradha, V., & Rengaraj, M. (2017). Storytelling: Creating a Positive Attitude Toward Narration Among Engineering Graduates. IUP Journal of English Studies, 12(1), 32.
- Azevedo, R., & Cromley, J.G. (2004). Does training on self-regulated learning facilitate students' learning with hypermedia? Journal of educational psychology, 96(3), 523.
- Barnard, L., Lan, W.Y., To, Y.M., Paton, V.O., & Lai, S.-L. (2009). Measuring self-regulation in online and blended learning environments. The Internet and Higher Education, 12(1), 1-6.
- Berardi, V., & Blundell, G.E. (2014). A learning theory conceptual foundation for using capture technology in teaching. Information Systems Education Journal, 12(2), 64.
- Blum, M., & Barger, A. (2017). The CASPA Model: An Emerging Approach to Integrating Multimodal Assignments. Paper presented at the EdMedia: World Conference on Educational Media and Technology 2017, Washington, DC. Https://www.learntechlib.org/p/178379 Boulos, M.N.K., Maramba, I., & Wheeler, S. (2006). Wikis, blogs and podcasts: a new generation of Web-based tools for virtual collaborative clinical practice and education. BMC medical education, 6(1), 41.
- Bower, M., Hedberg, J.G., & Kuswara, A. (2010). A framework for Web 2.0 learning design. Educational Media International, 47(3), 177-198.
- Braun, M. (2017). Comparative Evaluation of Online and In-Class Student Team Presentations. Journal of University Teaching& Learning Practice, 14(3), 3.
- Calder, N. (2012). The layering of mathematical interpretations through digital media. Educational Studies in Mathematics, 80(1-2), 269-285.
- Campbell, L.O., & Cox, T.D. (2018). Digital Video as a Personalized Learning Assignment: A Qualitative Study of Student Authored Video Using the ICSDR Model. Journal of the Scholarship of Teaching and Learning, 18(1), 11-24.
- Cohen, L., Manion, L., & Morrison, K. (2002). Research methods in education: Routledge.
- Costello, A.B., & Osborne, J.W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical assessment, research& Evaluation, 10(7), 1-9.
- Coulson, S., & Frawley, J.K. (2017). Student-generated multimedia for supporting learning in an undergraduate physiotherapy course. Paper presented at the ASCILITE2017: 34th International Conference on Innovation, Practice and Research in the Use of Educational Technologies in Tertiary Education, Toowoomba, QLD.
- Cox, A.M., Vasconcelos, A.C., & Holdridge, P. (2010). Diversifying assessment through multimedia creation in a non‐technical module: reflections on the MAIK project. Assessment& Evaluation in Higher Education, 35(7), 831-846.
- Georgiou, H., Nielsen, W., Doran, Y., Turney, A., & Jones, P. (2017). Analysing student-generated digital media in science. Paper presented at the Proceedings of The Australian Conference on Science and Mathematics Education (formerly UniServe Science Conference).
- Gorissen, P., Bruggen, J.V., & Jochems, W. (2013). Methodological triangulation of the students' use of recorded lectures. International Journal of Learning Technology, 8(1), 20-40.
- Greene, H., & Crespi, C. (2012). The value of student-created videos in the college classroom–an exploratory study in marketing and accounting. International Journal of Arts and Sciences, 5(1), 273-283.
- Harrington, D. (2009). Confirmatory factor analysis: Oxford University Press.
- Henriksen, B., Henriksen, J., & Thurston, J.S. (2016). Building Health Literacy and Cultural Competency Through Video Recording Exercises. INNOVATIONS in pharmacy, 7(4), 17.
- Hoban, G., & Nielsen, W. (2013). Learning Science through Creating a ‘Slowmation’: A case study of preservice primary teachers. International Journal of Science Education, 35(1), 119-146.
- Hoban, G., Nielsen, W., & Shepherd, A. (2015). Student-generated Digital Media in Science Education: Learning, Explaining and Communicating Content: Routledge.
- Hobbs, R. (2017). Create to Learn: Introduction to Digital Literacy: John Wiley& Sons.
- Jenson, J.D. (2011). Promoting self-regulation and critical reflection through writing students’ use of electronic portfolio. International Journal of ePortfolio, 1(1), 49-60.
- Johnson, C.I., & Mayer, R.E. (2010). Applying the self-explanation principle to multimedia learning in a computerbased game-like environment. Computers in Human Behavior, 26(6), 1246-1252.
- Kearney, M. (2009). Towards a learning design for student-generated digital storytelling.
- Kearney, M. (2013). Learner-generated digital video: Using Ideas Videos in Teacher Education. Journal of Technology and Teacher Education, 21(3), 321-336.
- Kearney, M., & Schuck, S. (2003). Focus on pedagogy: The use of digital video and iMovie in K-12 schools. Paper presented at the Apple University Consortium Conference. Sydney, Apple Computer Australia.
- Kearney, M., & Schuck, S. (2005). Students in the director’s seat: Teaching and learning with student-generated video. Paper presented at the Proceedings of Ed-Media 2005 World Conference on Educational Multimedia, Hypermedia and Telecommunications.
- Ludewig, A. (2001). IMovie. A student project with many side-effects. E-Xplore.
- Malamed, C. (2015). Visual Design Solutions: Principles and Creative Inspiration for Learning Professionals. Hoboken, New Jersey: John Wiley& Sons.
- McLoughlin, C., & Loch, B. (2012). Engaging students in cognitive and metacognitive processes using screencasts. Paper presented at the EdMedia: World Conference on Educational Media and Technology 2012, Denver, Colorado, USA. Http://www.editlib.org/p/40891
- Miller, D.A. (2015). Learning How Students Learn: An Exploration of Self-Regulation Strategies in a Two-Year College General Chemistry Class. Journal of College Science Teaching, 44(3), 11-16.
- Morel, G., & Keahey, H. (2016). Student-generated multimedia projects as a multidimensional assessment method in a health information management graduate program. Paper presented at the Society for Information Technology& Teacher Education International Conference.
- Nielsen, W., Hoban, G., & Hyland, C. (2017). Pharmacology Students’ Perceptions of Creating Multimodal Digital Explanations. Chemistry Education Research and Practice, 18(2), 329-339.
- O'Reilly, T. (2009). What is web 2.0: " O'Reilly Media, Inc.".
- Ohler, J. (2009). New-media literacies. Academe, 95(3), 30.
- Ottenhoff, J. (2011). Learning How to Learn: Metacognition in Liberal Education. Liberal Education, 97, 28-33.
- Pearce, K.L. (2014). Undergraduate creators of video, animations and blended media: The students' perspective. Paper presented at the Proceedings of The Australian Conference on Science and Mathematics Education (formerly UniServe Science Conference).
- Pearce, K.L., & Vanderlelie, J.J. (2016). Teaching and evaluating graduate attributes in multimedia science-based assessment task. Paper presented at the Proceedings of The Australian Conference on Science and Mathematics Education, The University of Queensland, Australia.
- Phillips, R., McNaught, C., & Kennedy, G. (2012). Evaluating e-learning: Guiding research and practice: Routledge.
- Pintrich, P.R. (1991). A manual for the use of the Motivated Strategies for Learning Questionnaire (MSLQ).
- Pirhonen, J., & Rasi, P. (2016). Student-generated instructional videos facilitate learning through positive emotions. Journal of Biological Education, 1-13.
- Powell, L., & Robson, F. (2014). Learner-generated podcasts: a useful approach to assessment? Innovations in Education and Teaching International, 51(3), 326-337.
- Powell, L.M. (2015). Evaluating the Effectiveness of Self-Created Student Screencasts as a Tool to Increase Student Learning Outcomes in a Hands-On Computer Programming Course. Information Systems Education Journal, 13(5), 106.
- Prensky, M. (2001). Digital natives, digital immigrants part 1. On the horizon, 9(5), 1-6.
- Reyna, J., Hanham, J., & Meier, P. (2018). The Internet explosion, digital media principles and implications to communicate effectively in the digital space. E-learning and Digital Media, 15(1), 36-52.
- Reyna, J., Meier, P., Geronimo, F., & Rodgers, K. (2016). Implementing Digital Media Presentations as Assessment Tools for Pharmacology Students. American Journal of Educational Research, 4(14), 983-991.
- Schunk, D.H., & Zimmerman, B. (2011). Handbook of self-regulation of learning and performance: Taylor& Francis.
- Sieber, S.D. (1973). The integration of fieldwork and survey methods. American journal of sociology, 78(6), 13351359.
- Solomon, G., & Schrum, L. (2007). Web 2.0: New tools, new schools: ISTE (Interntl Soc Tech Educ.
- Tashakkori, A., & Teddlie, C. (2010). Sage handbook of mixed methods in social& Behavioural research: Sage.
- Theodosakis, N. (2001). The director in the classroom: How thinking inspires learning: San Diego, CA: Tech4learning Publishing.
- Vasilchenko, A., Green, D.P., Qarabash, H., Preston, A., Bartindale, T., & Balaam, M. (2017). Media Literacy as a By-Product of Collaborative Video Production by CS Students. Paper presented at the Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education.
- Willey, K., & Gardner, A. (2010). Investigating the capacity of self and peer assessment activities to engage students and promote learning. European Journal of Engineering Education, 35(4), 429-443.
- Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian Journal of Paramedicine, 8(3).
- Williams, J., & Jacobs, J. (2004). Exploring the use of blogs as learning spaces in the higher education sector. Australasian Journal of Educational Technology, 20(2), 232-247.
- Wolters, C.A., Pintrich, P.R., & Karabenick, S.A. (2005). Assessing academic self-regulated learning What Do Children Need to Flourish? (pp. 251-270): Springer.
- Zimmerman, B.J. (2002). Achieving academic excellence: A self-regulatory perspective. The pursuit of excellence through education, 85-110.
- Zimmerman, B.J., & Pons, M.M. (1986). Development of a structured interview for assessing student use of selfregulated learning strategies. American Educational Research Journal, 23(4), 614-628.
These references have been extracted automatically and may have some errors. If you see a mistake in the references above, please contact email@example.com.