Mobile virtual reality for musical genre learning in primary education
ARTICLE
Edoardo Degli Innocenti, Dept. of Information Engineering, Italy ; Michele Geronazzo, Dept. of Architecture, Denmark ; Diego Vescovi, Dept. of Information Engineering, Italy ; Rolf Nordahl, Stefania Serafin, Dept. of Architecture, Denmark ; Luca Andrea Ludovico, Federico Avanzini, Dept. of Computer Science, Italy
Computers & Education Volume 139, Number 1, ISSN 0360-1315 Publisher: Elsevier Ltd
Abstract
Mobile virtual reality (VR) is increasingly becoming popular and accessible to everyone that holds a smartphone. In particular, digital didactics can take advantage of natural interaction and immersion in virtual environments, starting from primary education. This paper investigates the problem of enhancing music learning in primary education through the use of mobile VR. To this end, technical and methodological frameworks were developed, and were tested with two classes in the last year of a primary school (10 years old children). The classes were involved in an evaluation study on music genre identification and learning with a multi-platform mobile application called VR4EDU. Students were immersed in music performances of different genres (e.g., classical, country, jazz, and swing), navigating inside several musical rooms. The evaluation of the didactic protocol shows a statistically significant improvement in learning genre characterization (i.e., typical instruments and their spatial arrangements on stage) compared to traditional lessons with printed materials and passive listening. These results show that the use of mobile VR technologies in synergy with traditional teaching methodologies can improve the music learning experience in primary education, in terms of active listening, attention, and time. The inclusion of pupils with certified special needs strengthened our results.
Citation
Innocenti, E.D., Geronazzo, M., Vescovi, D., Nordahl, R., Serafin, S., Ludovico, L.A. & Avanzini, F. (2019). Mobile virtual reality for musical genre learning in primary education. Computers & Education, 139(1), 102-117. Elsevier Ltd. Retrieved March 19, 2024 from https://www.learntechlib.org/p/209947/.
This record was imported from Computers & Education on June 3, 2019. Computers & Education is a publication of Elsevier.
Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.compedu.2019.04.010Keywords
References
View References & Citations Map- Abdullah, F., Kassim, M.H.B., & Sanusi, A.N.Z. (2017). Go virtual: Exploring augmented reality application in representation of steel architectural construction for the enhancement of architecture education. Advanced Science Letters, 23(2), pp. 804-808.
- Ainscow, M., & Sandill, A. (2010). Developing inclusive education systems: The role of organisational cultures and leadership. Int. J. of Inclusive Education, 14(4), pp. 401-416.
- Amer, A., & Peralez, P. (2014). Affordable altered perspectives: Making augmented and virtual reality technology accessible. IEEE global humanitarian technology conference (GHTC 2014), pp. 603-608.
- Aufegger, L., Perkins, R., Wasley, D., & Williamon, A. (2017). Musicians perceptions and experiences of using simulation training to develop performance skills. Psychology of Music, 45(3), pp. 417-431.
- Ball, C., & Johnsen, K. (2016). An accessible platform for everyday educational virtual reality. Everyday virtual reality (WEVR), 2016 IEEE 2nd workshop on, IEEE, pp. 26-31.
- Berthaut, F., & Hachet, M. (2016). Spatial interfaces and interactive 3d environments for immersive musical performances. IEEE Computer Graphics and Applications, 36(5), pp. 82-87.
- Bormann, K. (2005). Presence and the utility of audio spatialization. Presence, 14(3), pp. 278-297.
- Burgess, N. (2006). Spatial memory: How egocentric and allocentric combine. Trends in Cognitive Sciences, 10(12), pp. 551-557.
- Byrne, C., & Furness, T.A. (1994). Virtual reality and education. Exploring a new partnership: Children, pp. 181-189.
- Casu, A., Spano, L.D., Sorrentino, F., & Scateni, R. (2015). Riftart: Bringing masterpieces in the classroom through immersive virtual reality. Eurographics Italian chapter conference, pp. 77-84.
- Chersi, F., & Burgess, N. (2015). The cognitive architecture of spatial navigation: Hippocampal and striatal contributions. Neuron, 88(1), pp. 64-77.
- Chow, J., Feng, H., Amor, R., & Wünsche, B.C. (2013). Music education using augmented reality with a head mounted display. Proceedings of the fourteenth Australasian user interface conference-volume 139, pp. 73-79.
- Christopoulos, A., Conrad, M., & Shukla, M. (2018). Increasing student engagement through virtual interactions: How?. Virtual Reality, pp. 1-17.
- Council, N.R. (2000). How people learn: Brain, mind, experience, and school.
- Cowan, N., Fristoe, N.M., Elliott, E.M., Brunner, R.P., & Saults, J.S. (2006). Scope of attention, control of attention, and intelligence in children and adults. Memory & Cognition, 34(8), pp. 1754-1768.
- Črnčec, R., Wilson, S.J., & Prior, M. (2006). The cognitive and academic benefits of music to children: Facts and fiction. Educational Psychology, 26(4), pp. 579-594.
- Dalgarno, B., & Lee, M.J.W. (2010). What are the learning affordances of 3-D virtual environments?. British Journal of Educational Technology, 41(1), pp. 10-32.
- De Jong, T., Linn, M.C., & Zacharia, Z.C. (2013). Physical and virtual laboratories in science and engineering education. Science, 340(6130), pp. 305-308.
- Dede, C. (2009). Immersive interfaces for engagement and learning. Science, 323(5910), pp. 66-69.
- Eschrich, S., Mnte, T.F., & Altenmller, E.O. (2008). Unforgettable film music: The role of emotion in episodic long-term memory for music. BMC Neuroscience, 9, p. 48.
- Fontana, F., Papetti, S., Jrvelinen, H., & Avanzini, F. (2017). Detection of keyboard vibrations and effects on perceived piano quality. Journal of the Acoustical Society of America, 142(5), pp. 2953-2967.
- Geronazzo, M., Bedin, A., Brayda, L., Campus, C., & Avanzini, F. (2016). Interactive spatial sonification for non-visual exploration of virtual maps. International Journal of Human-Computer Studies, 85, pp. 4-15.
- Geronazzo, M., Peruch, E., Prandoni, F., & Avanzini, F. (2017). Improving elevation perception with a tool for image-guided head-related transfer function selection. Proc. Of the 20th int. Conference on digital audio effects (DAFx-17), Edinburgh, UK, pp. 397-404.
- Gorini, A., & Riva, G. (2008). Virtual reality in anxiety disorders: The past and the future. Expert Review of Neurotherapeutics, 8(2), pp. 215-233.
- Hamilton, R., & Platz, C. (2016). Gesture-based collaborative virtual reality performance in carillon. Proceedings of the international computer music conference 2016, pp. 337-340.
- Hürst, W., & Helder, M. (2011). Mobile 3d graphics and virtual reality interaction. Proceedings of the 8th international conference on advances in computer entertainment technology, p. 28. New York, NY, USA: ACE ’11ACM.
- Hwang, I., Son, H., & Kim, J.R. (2017). Airpiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback. World haptics conference (WHC), 2017 IEEE, pp. 213-218.
- Jäncke, L. (2008). Music, memory and emotion. Journal of Biology, 7(6), p. 21.
- Jang, S., Vitale, J.M., Jyung, R.W., & Black, J.B. (2017). Direct manipulation is better than passive viewing for learning anatomy in a three-dimensional virtual reality environment. Computers & Education, 106, pp. 150-165.
- Johanna, K., Romero, G., Andres, D., Lopez, R., Luengas, L.A., & Carlos, J. (2010). Virtual flute: Electronic device that uses virtual reality to teach how to play a flute. IEEE education engineering (EDUCON), pp. 211-216.
- Khan, A., Matejka, J., Fitzmaurice, G., & Kurtenbach, G. (2005). Spotlight: Directing users' attention on large displays. Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’05, ACM, New York, NY, USA, pp. 791-798.
- Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation.
- Lim, D.H., Han, S.J., Oh, J., & Jang, C.S. (2019). Application of virtual and augmented reality for training and mentoring of higher education instructors. Handbook of research on virtual training and mentoring of online instructors, pp. 325-344.
- Mandler, J.M., Seegmiller, D., & Day, J. (1977). On the coding of spatial information. Memory & Cognition, 5(1), pp. 10-16.
- Merchant, Z., Goetz, E.T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T.J. (2014). Effectiveness of virtual reality-based instruction on students' learning outcomes in k-12 and higher education: A meta-analysis. Computers & Education, 70, pp. 29-40.
- Merchant, Z., Goetz, E.T., Keeney-Kennicutt, W., Kwok, O.-m., Cifuentes, L., & Davis, T.J. (2012). The learner characteristics, features of desktop 3d virtual reality environments, and college chemistry instruction: A structural equation modeling analysis. Computers & Education, 59(2), pp. 551-568.
- Miendlarzewska, E.A., & Trost, W.J. (2014). How musical training affects cognitive development: Rhythm, reward and other modulating variables. Frontiers in Neuroscience, 7.
- Moreno-Ger, P., Torrente, J., Bustamante, J., Fernández-Galaz, C., Fernández-Manjón, B., & Comas-Rengifo, M.D. (2010). Application of a low-cost web-based simulation to improve students practical skills in medical education. International Journal of Medical Informatics, 79(6), pp. 459-467.
- Moro, C., Štromberga, Z., & Stirling, A. (2017). Virtualisation devices for student learning: Comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education. Australasian Journal of Educational Technology, 33(6), pp. 1-10.
- Orman, E.K., Price, H.E., & Russell, C.R. (2017). Feasibility of using an augmented immersive virtual reality learning environment to enhance music conducting skills. Journal of Music Teacher Education, 27(1), pp. 24-35.
- Pelargos, P.E., Nagasawa, D.T., Lagman, C., Tenn, S., Demos, J.V., & Lee, S.J. (2017). Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery. Journal of Clinical Neuroscience, 35, pp. 1-4.
- Ragan, E.D., Bowman, D.A., & Huber, K.J. (2012). Supporting cognitive processing with spatial information presentations in virtual environments. Virtual Reality, 16(4), pp. 301-314.
- Riva, G., Mantovani, F., Capideville, C.S., Preziosa, A., Morganti, F., & Villani, D. (2007). Affective interactions using virtual reality: The link between presence and emotions. CyberPsychology and Behavior, 10(1), pp. 45-56.
- Romigh, G.D., & Simpson, B.D. (2014). Do you hear where I hear?: Isolating the individualized sound localization cues. Frontiers in Neuroscience, 8, p. 370.
- Ruijten, P.A.M., Kruyt-Beursken, E., & IJsselsteijn, W.A. (2018). Towards the simplicity of complex interfaces: Applying ephemeral adaptation to enhance user performance and satisfaction. Symbiotic interaction, pp. 86-97. Cham: Springer International Publishing.
- Rusiñol, M., Chazalon, J., & Diaz-Chito, K. (2018). Augmented songbook: An augmented reality educational application for raising music awareness. Multimedia Tools and Applications, 77(11), pp. 13773-13798.
- Sala, G., & Gobet, F. (2017). When the music's over. Does music skill transfer to children's and young adolescents' cognitive and academic skills? A meta-analysis. Educational Research Review, 20, pp. 55-67.
- Sauzon, H., Arvind Pala, P., Larrue, F., Wallet, G., Djos, M., & Zheng, X. (2011). The use of virtual reality for episodic memory assessment: Effects of active navigation. Experimental Psychology, 59(2), pp. 99-108.
- Schank, R.C., Berman, T.R., & Macpherson, K.A. (1999). Learning by doing, Instructional-design theories and models. A New Paradigm Of Instructional Theory, 2, pp. 161-181.
- Serafin, S., Adjorlu, A., Nilsson, N., Thomsen, L., & Nordahl, R. (2017). Considerations on the use of virtual and augmented reality technologies in music education. K-12 embodied learning through virtual & augmented reality (KELVAR), 2017 IEEE virtual reality workshop on, IEEE, pp. 1-4.
- Serafin, S., Erkut, C., Kojs, J., Nilsson, N.C., & Nordahl, R. (2016). Virtual reality musical instruments: State of the art, design principles, and future directions. Computer Music Journal, 40(3), pp. 22-40.
- Settgast, V., Pirker, J., Lontschar, S., Maggale, S., & Gütl, C. (2016). Evaluating experiences in different virtual reality setups. International conference on entertainment computing, pp. 115-125.
- Singh, G., Bowman, D.A., Hicks, D., Cline, D., Ogle, J.T., & Johnson, A. (2015). Designing a mobile augmented reality system for scaffolding historical inquiry learning. 2015 IEEE international symposium on mixed and augmented reality - media, art, social science, humanities and design, pp. 9-14.
- Smith, S.M., & Vela, E. (2001). Environmental context-dependent memory: A review and meta-analysis. Psychonomic Bulletin & Review, 8(2), pp. 203-220.
- Steinicke, F., Visell, Y., Campos, J., & Lécuyer, A. (2013). Human walking in virtual environments.
- Tulving, E., & Osler, S. (1968). Effectiveness of retrieval cues in memory for words. Journal of Experimental Psychology, 77(4), pp. 593-601.
- Usoh, M., Arthur, K., Whitton, M.C., Bastos, R., Steed, A., & Slater, M. (1999). Walking¿ walking-in-place¿ flying, in virtual environments. Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 359-364.
- Vorländer, M. (2007). Auralization: Fundamentals of acoustics, modelling, simulation, algorithms and acoustic virtual reality. Incorporated: Springer Publishing Company.
- Wiener, J.M., Bchner, S.J., & Hlscher, C. (2009). Taxonomy of human wayfinding tasks: A knowledge-based approach. Spatial Cognition and Computation, 9(2), pp. 152-165.
- Woods, R., Davis, K., & Scharff, L. (2005). Effects of typeface and font size on legibility for children. Am. J. of Psychological Research, 1(1), pp. 86-102.
- Wrzesien, M., & Alcaiz Raya, M. (2010). Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project. Computers & Education, 55(1), pp. 178-187.
- Xiao, X., Puentes, P., Ackermann, E., & Ishii, H. (2016). Andantino: Teaching children piano with projected animated characters. Proceedings of the the 15th international conference on interaction design and children, pp. 37-45.
- Xiao, X., Tome, B., & Ishii, H. (2014). Andante: Walking figures on the piano keyboard to visualize musical motion. The int. Conf. On new interfaces for musical expression (NIME), pp. 629-632.
- Youngblut, C. (1998). Educational uses of virtual reality technology. Tech. rep Alexandria, Va: Institute for Defense Analyses.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to References