You are here:

Evaluating CSL/CFL Website Usability: A User-centered Design Approach
ARTICLE

, , University of Texas at Austin, United States ; , National Taiwan Normal University, Taiwan

Journal of Educational Multimedia and Hypermedia Volume 19, Number 2, ISSN 1055-8896 Publisher: Association for the Advancement of Computing in Education (AACE), Waynesville, NC USA

Abstract

With the widespread availability of Internet and computer technology, on-line web-based learning has become prevalent in the field of teaching Chinese as a second/foreign language (CSL/CFL). This study examined the concepts of usability and types of design elements that help construct an effective web-based learning environment, as well as
their relationship with user perspectives from both CSL/CFL learners and teachers. The participants’ navigation experiences were
investigated as they performed and reflected upon the guided usability tasks on assigned websites via a semi-structured think-aloud
interview. Captivate and Audacity software were used purposively to capture users’ navigation paths and record reflections during each test section. The findings provide a profile of design issues and
examples in terms of interface, information and interaction along with pedagogical suggestions to consider in future CSL/CFL website design
and development.

Citation

Huang, C.K., Hsin, C.O. & Chiu, C.H. (2010). Evaluating CSL/CFL Website Usability: A User-centered Design Approach. Journal of Educational Multimedia and Hypermedia, 19(2), 177-210. Waynesville, NC USA: Association for the Advancement of Computing in Education (AACE). Retrieved January 18, 2019 from .

Keywords

View References & Citations Map

References

  1. Barnum, M.C. (2002). Usability testing and research. New York: Longman.
  2. BBC News. (2007, January 9). Mandarin learning soars outside China. BBC News. Retrieved from http://news.bbc.co.uk/go/pr/fr/-/2/hi/asia-pacific/6244763.stm Beijing Language and Culture University. (2008). Introduction to the HSK. Retrieved March 10, 2010, from http://www.hsk.org.cn/Index_E.aspx
  3. Bevan, N. (2009). International standards for usability should be more widely used. Journal of Usability Studies, 4(3), 106-113.
  4. Chang, L.-P. (2007). 華語文能力測驗發展現況 [The current development of Test of Proficiency—Huayu]. Retrieved May 21, 2010, from http://www.sc-top.org.tw/download/research/Li_Ping_Chang_01.pdf
  5. Chen, H.-Y., & Liu, K.-Y. (2008). Web-based synchronized multimedia lecture system design for teaching/learning Chinese as second language. Computers& Education, 50(3), 693-702. Doi:10.1016/J.compedu.2006.07.010.
  6. Chiu, C.-H. (2008). ActiveChinese: Chinese language skills for the business world. Language Learning& Technology, 12(3), 23-32. Retrieved from http://llt.msu.edu/vol12num3/review2.pdf
  7. College Entrance Examination Board. (2009). AP Chinese language and culture. Retrieved September 30, 2009, from http://professionals.collegeboard.com/profdownload/AP-Chinese-Exam-Overview.pdf
  8. Downey, L.L. (2007). Group usability testing: Evolution in usability techniques. Journal of Usability Studies 2(3), 133-144.
  9. Dumas, S.J., & Redish, C.J. (1999). A practical guide to usability testing (Rev. Ed.). Portland, Oregon: Intellect Books. ESchool News. (2006, January 13). Tech fosters Chinese language learning: Number of K-12 students learning Chinese on the rise. ESchool News. Retrieved from http://www.eschoolnews.com/news/top-news/index.cfm?i=36754&CFID=7759200&CFTO KEN=96746420
  10. Faulkner, L. (2003). Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. Behavior Research Methods, Instruments, & Computers, 35(3), 379-383.
  11. Graham, L. (1998). The principles of interactive design. Albany, NY: Delmar Publishers.
  12. Hancock, R.D., & Algozzine, B. (2006). Doing case study research: A practical guide for beginning researchers. New York: Teachers College Press.
  13. Hornbæk, K. (2010). Dogmas in the assessment of usability evaluation methods. Behaviour& Information Technology, 29(1), 97-111.
  14. Horton, S. (2005). Access by design: A guide to universal usability for web designers. Berkeley, CA: New Riders.
  15. Huang, C.-K., Chao, Y.-C., & Lin, C.-Y. (2008). Web 2.0 in and out of the language classroom. Proceedings of the 2008 World CALL: Using Technologies for Language Learning. Foukoka, Japan, q-039.
  16. Huang, C.-K., Lin, C.-Y., & Chiang, Y.-H. (2010). Incorporating competency-based blended learning in a Chinese language classroom: A Web 2.0 Drupal module design. International Journal on E-Learning, 9(4). Retrieved March 10, 2010 from AACE publication database.
  17. Koohang, A., & Du Plessis, J. (2004). Architecting usability properties in the e-Learning instructional design process. International Journal on E-Learning, 3(3), 38-44.
  18. Krug, S. (2006). Don’t make me think: A commonsense approach to web usability (2nd ed.). Berkeley, CA: New Riders
  19. Ku, H.-Y., & Lohr, L.L. (2006). A case study of Chinese students’ attitudes toward their first online learning experience. Educational Technology Research and Development, 51(3), 95-102.
  20. Kukulska-Hulme, A. (1999). Language and communication: Essential concepts for user interface and documentation design. New York: Oxford University Press.
  21. Lan, Y.J. (2009, July). 資訊融入華語教學設計理念與實踐 [Technology integration in the philosophy and practice of Chinese language instructional design]. Paper presented at the International Conference on Internet Chinese Education (ICICE 2009), Taipei, Taiwan.
  22. Lanclos, P. (2008). Weaving Web 2.0 tools into the classroom. Eugene, OR: Visions Technology.
  23. Lim, C.J., & Lee, S. (2007). Pedagogical usability checklist for ESL/EFL e-learning web-Evaluating CSL/CFL Website Usability: A User-centered Design 207
  24. Lin, M.-C., & Wang, P.-Y. (2008). A knowledge management system for Chinese language arts teachers. British Journal of Educational Technology, 39(5), 935-943.
  25. Liu, M., Traphagan, T., Huh, J., Koh, Y.I., Choi, G., & McGregor, A. (2008). Designing Websites for ESL learners: A usability testing study. CALICO Journal, 25(2), 207240.
  26. Lund, M.A. (2006). Post-modern usability. Journal of Usability Studies, 2(1), 1-6.
  27. Lynch, J.P., & Horton, S. (2008). Web style guide: Basic design principles for creating websites (3rd ed.). New Haven, CT: Yale University Press.
  28. Mayer, E.R. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.
  29. McLeod, J., & Vasinda, S. (2008). Critical literacy and Web 2.0: Exercising and negotiating power. Computers in the Schools, 25(3), 259-274. Doi:10.1080/07380560802394815
  30. Mehlenbacher, B. (2002). Assessing the usability of online instructional materials. In R.S. Anderson, J.F. Bauer& B.W. Speck (Eds.), Assessment strategies for the online class: From theory to practice (pp. 91-98). San Francisco: Jossey-Bass.
  31. Merriam, B.S. (1998). Qualitative research and case study applications in education: Revised and expanded from case study research in education. San Francisco: JosseyBass.
  32. Nielsen, J. (1993). Usability engineering. San Diego, CA: Academic Press.
  33. Nielsen, J., & Landauer, K.T. (1993). A mathematical model of the finding of usability problems. Proceedings of ACM INTERCHI’93 Conference, Amsterdam, Netherlands, 206-213.
  34. Nielsen, J., & Loranger, H. (2006). Prioritizing web usability. Berkeley, CA: New Riders.
  35. Nokelainen, P. (2006). An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students. Educational Technology& Society, 9(2), 178-197.
  36. Norman, D.A. (2002). The design of everyday things. New York: Basic Books.
  37. Peterson, M. (1998). The virtual learning environment: The design of a website for language learning. Computer Assisted Language Learning 11(4), 349-361. Doi:10.1076/call.11.4.349.5669
  38. Phyo, A. (2003). Return on design: Smarter web design that works. Berkeley, CA: New Riders.
  39. Ronnie, L. (2007). The practical guide to information design. Hoboken, NJ: John Wiley& Sons Inc.
  40. Rubin, J. & Chisnell, D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests (2nd ed.). New York: Wiley.
  41. Sharp, H., Rogers, Y., & Preece, J. (2007). Interaction design: Beyond human-computer interaction. Chichester, UK: John Wiley& Sons.
  42. Shedroff, N. (1994). Information interaction design: A unified field theory of design. Retrieved May 22, 2010, from http://www.nathan.com/thoughts/unified/ Shield, L., & Kukulska-Hulme, A. (2006). Are language learning websites special? Towards a research agenda for discipline-specific usability. Journal of Educational Multimedia and Hypermedia, 15(3), 349-369.
  43. Tidwell, J. (2006). Designing interfaces. Sebastopol, CA: O’Reilly Media.
  44. Tsou, W., Wang, W., & Tzeng, Y. (2006). Applying a multimedia storytelling website in foreign language learning. Computers& Education, 47(1), 17-28. Doi:10.1016/J.Compedu.2004.08.013
  45. Wu, S.-M. (2008). Robust learning for Chinese heritage learners: Motivation, linguistics and technology. In K. Kondo-Brown& D.D. James (Eds.), Teaching Chinese, Japanese, and Korean heritage language students: Curriculum needs, materials, and assessment. New York: Lawrence Erlbaum Associates.
  46. Yin, R.K. (2003). Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage.
  47. Zaphiris, P., & Kurniawan, S. (2007). Human computer interaction research in web design and evaluation. Hershey, PA: Idea Group
  48. Zhu, F. (2009). Chinese 101 & 102. CALICO Journal, 26(2), 457-467.

These references have been extracted automatically and may have some errors. If you see a mistake in the references above, please contact info@learntechlib.org.