Reading behavior and the effect of embedded selfies in role-playing picture e-books: An eye-tracking investigation
ARTICLE
Gloria Yi-Ming Kao, Xin-Zhi Chiang, Graduate Institute of Digital Learning and Education ; Tom Foulsham, Department of Psychology, United Kingdom
Computers & Education Volume 136, Number 1, ISSN 0360-1315 Publisher: Elsevier Ltd
Abstract
Digital and interactive media platforms, such as e-books, are becoming important tools in reading and education. In particular, picture e-books can embed multimedia effects such as sound, animation or personalized images, with potential benefits for learning and engagement. However, little is known about how such e-books are read, and most designs remain untested. In this study, an innovative type of role-playing picture e-book entitled “The Prank in the Forest” was designed which provides three different role-playing approaches: emotive selfies that allow the reader to appear as one of the main characters and were varied according to the story development, a fixed selfie that was the same on each page, or no selfie. Sixty-five students were randomly assigned to the emotive selfie, fixed selfie, and no selfie groups. To understand students’ online reading processes, their eye movements were tracked. The results showed that the emotive selfies attracted attention to the main character and also promoted scanning between text and pictures, indicating a better integration of the written and pictorial information. The selfie design led to distinct scanpaths, and this was particularly true when emotive selfies were embedded which responded to the context. Self-report questionnaires of reading motivation and engagement demonstrated that this condition was also the most engaging design for readers. We conclude that emotive selfies can boost reading engagement since they encourage the reader to observe the development of the story from the role he/she chose to play, and we discuss how embodying the reader within the graphics can enhance role-play activities with the potential for improved educational outcomes. We suggest this emotive selfie role-playing design could be applied in e-book user interfaces to create more interaction and personal meaning for the readers.
Citation
Kao, G.Y.M., Chiang, X.Z. & Foulsham, T. (2019). Reading behavior and the effect of embedded selfies in role-playing picture e-books: An eye-tracking investigation. Computers & Education, 136(1), 99-112. Elsevier Ltd. Retrieved March 19, 2024 from https://www.learntechlib.org/p/208393/.
This record was imported from Computers & Education on April 7, 2019. Computers & Education is a publication of Elsevier.
Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.compedu.2019.03.010Keywords
References
View References & Citations Map- Al-Bahrani, A., Holder, K., Moryl, R.L., Murphy, P.R., & Patel, D. (2016). Putting yourself in the picture with an ‘ECONSelfie’: Using student-generated photos to enhance introductory economics courses. International Review of Economics Education, 22, pp. 16-22.
- Anderson, N.C., Anderson, F., Kingstone, A., & Bischof, W.F. (2015). A comparison of scanpath comparison methods. Behavior Research Methods, 47(4), pp. 1377-1392.
- Beymer, D., Orton, P.Z., & Russell, D.M. (2007). An eye tracking study of how pictures influence online reading. IFIP conference on human-computer interaction, pp. 456-460. Berlin, Heidelberg: Springer.
- Canham, M., & Hegarty, M. (2010). Effects of knowledge and display design on comprehension of complex graphics. Learning and Instruction, 20(2), pp. 155-166.
- Chien, K.P., Tsai, C.Y., Chen, H.L., Chang, W.H., & Chen, S. (2015). Learning differences and eye fixation patterns in virtual and physical science laboratories. Computers & Education, 82, pp. 191-201.
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York, NY: Academic Press.
- Colliot, T., & Jamet, É. (2018). Understanding the effects of a teacher video on learning from a multimedia document: An eye-tracking study. Educational Technology Research & Development, pp. 1-19.
- De Koning, B.B., Tabbers, H.K., Rikers, R.M.J.P., & Paas, F. (2010). Attention guidance in learning from a complex animation: Seeing is understanding?. Learning and Instruction, 20(2), pp. 111-122.
- Dewhurst, R., Foulsham, T., Jarodzka, H., Johansson, R., Holmqvist, K., & Nyström, M. (2018). How task demands influence scanpath similarity in a sequential number-search task. Vision Research, 149, pp. 9-23.
- Dinhopl, A., & Gretzel, U. (2016). Selfie-taking as touristic looking. Annals of Tourism Research, 57, pp. 126-139.
- Foulsham, T., & Underwood, G. (2008). What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision, 8(2).
- Gambrell, L.B. (2011). Seven rules of engagement: What's most important to know about motivation to read. The Reading Teacher, 65(3), pp. 172-178.
- Grant, J.M.A. (2004). Are electronic books effective in teaching young children reading and comprehension?. International Journal of Instructional Media, 31(3), pp. 303-308.
- Grimshaw, S., Dungworth, N., McKnight, C., & Morris, A. (2007). Electronic books: Children's reading and comprehension. British Journal of Educational Technology, 38(4), pp. 583-599.
- Hancock, J.T., & Toma, C.L. (2009). Putting your best face forward: The accuracy of online dating photographs. Journal of Communication, 59(2), pp. 367-386.
- Hawkins, D.T. (2000). Electronic books: A major publishing revolution. Part 1: General considerations and issues. Online, 24(4).
- Hegarty, M. (2010). Components of spatial intelligence. Psychology of learning and motivation, Vol. 52, pp. 265-297.
- Hegarty, M., & Just, M.A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32(6), pp. 717-742.
- Hyman, J.A., Moser, M.T., & Segala, L.N. (2014). Electronic reading and digital library technologies: Understanding learner expectation and usage intent for mobile learning. Educational Technology Research & Development, 62(1), pp. 35-52.
- Jorge, T.D., Cybis, P.A.T., & Matos, G.M. (2014). The sequential codes as mediators of interactivity in hypermedia narrative: An analysis of the eBook-APP cinderella. Blucher Design Proceedings, 1(2), pp. 1127-1139.
- Kalidas, C.S. (2014). Drama: A tool for learning. Procedia-Social and Behavioral Sciences, 123, pp. 444-449.
- Kao, G.Y.M., Tsai, C.C., Liu, C.Y., & Yang, C.H. (2016). The effects of high/low interactive electronic storybooks on elementary school students' reading motivation, story comprehension and chromatics concepts. Computers & Education, 100, pp. 56-70.
- Knoblich, G., Ohlsson, S., & Raney, G.E. (2001). An eye movement study of insight problem solving. Memory & Cognition, 29(7), pp. 1000-1009.
- Korat, O., & Shamir, A. (2007). Electronic books versus adult readers: Effects on children's emergent literacy as a function of social class. Journal of Computer Assisted Learning, 23(3), pp. 248-259.
- Korat, O., & Shamir, A. (2008). The educational electronic book as a tool for supporting children's emergent literacy in low versus middle SES groups. Computers & Education, 50(1), pp. 110-124.
- Lai, M.L., Tsai, M.J., Yang, F.Y., Hsu, C.Y., Liu, T.C., Lee, S.W.Y., (2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, pp. 90-115.
- Lazar, A. (2014). Setting the stage: Role-playing in the group work classroom. Social Work with Groups, 37(3), pp. 230-242.
- Lin, J.H., & Lin, S.J. (2014). Tracking eye movements when solving geometry problems with handwriting devices. Journal of Eye Movement Research, 7, pp. 1-15.
- Liu, Z. (2005). Reading behavior in the digital environment: Changes in reading behavior over the past ten years. Journal of Documentation, 61(6), pp. 700-712.
- Lyu, S.O. (2016). Travel selfies on social media as objectified self-presentation. Tourism Management, 54, pp. 185-195.
- Ma, G., & Li, X. (2015). How character complexity modulates eye movement control in Chinese reading. Reading and Writing, 28(6), pp. 747-761.
- Mangen, A., & Van der Weel, A. (2016). The evolution of reading in the age of digitisation: An integrative framework for reading research. Literacy, 50(3), pp. 116-124.
- Mason, L., Pluchino, P., Tornatora, M.C., & Ariasi, N. (2013). An eye-tracking study of learning from science text with concrete and abstract illustrations. The Journal of Experimental Education, 81(3), pp. 356-384.
- Mason, L., Tornatora, M.C., & Pluchino, P. (2013). Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns. Computers & Education, 60(1), pp. 95-109.
- Mayer, R.E. (2010). Unique contributions of eye-tracking research to the study of learning with graphics. Learning and Instruction, 20, pp. 167-171.
- Morgan, H. (2013). Multimodal children's e-books help young learners in reading. Early Childhood Education Journal, 41(4).
- Muir, L., & Hawes, G. (2013). The case for e-book literacy: Undergraduate students' experience with e-books for course work. The Journal of Academic Librarianship, 39(3), pp. 260-274.
- Muir, L.J., Veale, T., & Nichol, A. (2009). Like an open book? Accessibility of e-book content for academic study in a diverse student population. Library and Information Research, 33(105), pp. 90-109.
- Nadkarni, A., & Hofmann, S.G. (2012). Why do people use Facebook?. Personality and Individual Differences, 52(3), pp. 243-249.
- Pearce, J.M., Ainley, M., & Howard, S. (2005). The ebb and flow of online learning. Computers in Human Behavior, 21(5), pp. 745-771.
- Peterson, M. (2010). Massively multiplayer online role-playing games as arenas for second language learning. Computer Assisted Language Learning, 23(5), pp. 429-439.
- Qiu, L., Lu, J., Yang, S., Qu, W., & Zhu, T. (2015). What does your selfie say about you?. Computers in Human Behavior, 52, pp. 443-449.
- Roskos, K., Brueck, J., & Widman, S. (2009). Investigating analytic tools for e-book design in early literacy learning. The Journal of Interactive Online Learning, 8, pp. 218-240.
- Sargeant, B. (2013). Interactive storytelling: How picture book conventions inform multimedia book app narratives. Australian Journal of Intelligent Processing Systems, 13(3), pp. 29-35.
- Sargeant, B. (2015). What is an ebook? What is a book app? And why should we care? An analysis of contemporary digital picture books. Children's Literature in Education, pp. 1-13.
- Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010). A closer look at split visual attention in system-and self-paced instruction in multimedia learning. Learning and Instruction, 20(2), pp. 100-110.
- Schugar, H.R., Smith, C.A., & Schugar, J.T. (2013). Teaching with interactive picture e‐books in grades K–6. The Reading Teacher, 66(8), pp. 615-624.
- Shapiro, S., & Leopold, L. (2012). A critical role for role-playing pedagogy. TESL Canada Journal, 29(2), p. 120.
- Sharmin, S., Špakov, O., & Räihä, K.J. (2015). Dynamic text presentation in print interpreting–An eye movement study of reading behaviour. International Journal of Human-Computer Studies, 78, pp. 17-30.
- Takacs, Z.K., Swart, E.K., & Bus, A.G. (2015). Benefits and pitfalls of multimedia and interactive features in technology-enhanced storybooks: A meta-analysis. Review of Educational Research, 85(4), pp. 698-739.
- Tombak, A. (2014). Importance of drama in pre-school education. Procedia-Social and Behavioral Sciences, 143, pp. 372-378.
- Tsai, M.J., Hou, H.T., Lai, M.L., Liu, W.Y., & Yang, F.Y. (2012). Visual attention for solving multiple-choice science problem: An eye-tracking analysis. Computers & Education, 58(1), pp. 375-385.
- Tsao, W.L. (2005). A theoretical model Based on the flow Experience to Explore the Influence of Playfulness on Creativity in playing situation. Available online: https://ir.nctu.edu.tw/.
- Van Kraayenoord, C.E., & Paris, S.G. (1996). Story construction from a picture book: An assessment activity for young learners. Early Childhood Research Quarterly, 11(1), pp. 41-61.
- Wang, J.H.Y., & Guthrie, J. (2004). Modeling the effects of intrinsic motivation, extrinsic motivation, amount of reading, and past reading achievement on text comprehension between US and Chinese students. Reading Research Quarterly, 39(2), pp. 162-186.
- Watson, S.W., Smith, Z., & Driver, J. (2006). Alcohol, sex and illegal activities: An analysis of selected facebook central photos in fifty states., p. ED493049.
- Wigfield, A., & Guthrie, J.T. (1997). Relations of children's motivation for reading to the amount and breadth or their reading. Journal of Educational Psychology, 89(3), pp. 420-432.
- Woody, W.D., Daniel, D.B., & Baker, C.A. (2010). E-books or textbooks: Students prefer textbooks. Computers & Education, 55(3), pp. 945-948.
- Yang, Y.C. (2012). Using the Rasch Model to Examine the Psychometric Properties of the Motivation of Reading Questionnaire. Available online: https://ndltd.ncl.edu.tw/.
- Yang, F.Y., Chang, C.Y., Chien, W.R., Chien, Y.T., & Tseng, Y.H. (2013). Tracking learners' visual attention during a multimedia presentation in a real classroom. Computers & Education, 62, pp. 208-220.
- Yokota, J., & Teale, W.H. (2014). Picture books and the digital world: Educators making informed choices. The Reading Teacher, 67(8), pp. 577-585.
- Zickuhr, K., & Lee, R. (2014). E-Reading Rises as Device Ownership Jumps. Washington, DC: Pew Research Center. Available online: http://pewinternet.org/Reports/2014/E-Reading-Update.aspx.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to References