You are here:

Achievement or agreement – Which comes first? Clarifying the temporal ordering of achievement and within-class consensus on classroom goal structures
ARTICLE

, , , , , University of Vienna, Austria

Learning and Instruction Volume 61, Number 1, ISSN 0959-4752 Publisher: Elsevier Ltd

Abstract

Within-class consensus describes the extent to which students agree in their perceptions of classroom characteristics. The most frequently studied external link in research on within-class consensus is achievement. However, the direction of effects between consensus and achievement is disputed, and longitudinal studies that could add clarity are largely lacking. This study therefore investigated the temporal ordering of achievement and consensus. Consensus was assessed within the framework of classroom goal structures, and thus, for the three dimensions of task, autonomy, and recognition/evaluation. A total of 490 secondary school students (49.6% female, 31 classes) participated in the study. Results from multilevel cross-lagged panel models revealed no effect in either direction for task, but showed that higher class-average achievement at the first measurement wave positively predicted consensus on autonomy and recognition/evaluation at the second wave. The findings for autonomy and recognition/evaluation highlight the impact of achievement on consensus and raise opportunities for future research.

Citation

Bardach, L., Lüftenegger, M., Yanagida, T., Spiel, C. & Schober, B. (2019). Achievement or agreement – Which comes first? Clarifying the temporal ordering of achievement and within-class consensus on classroom goal structures. Learning and Instruction, 61(1), 72-83. Elsevier Ltd. Retrieved April 1, 2023 from .

This record was imported from Learning and Instruction on March 15, 2019. Learning and Instruction is a publication of Elsevier.

Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.learninstruc.2019.01.003

Keywords

References

View References & Citations Map
  1. Ames, C. (1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84, pp. 261-267.
  2. Ames, C., & Archer, J. (1988). Achievement goals in the classroom: Students' learning strategies and motivation processes. Journal of Educational Psychology, 80, pp. 260-267.
  3. Arens, K., & Morin, A.J.S. (2016). Relations between teachers' emotional exhaustion and students' educational outcomes. Journal of Educational Psychology, 108, pp. 800-813.
  4. Arens, A.K., Morin, A.J.S., & Watermann, R. (2015). Relations between classroom disciplinary problems and student motivation: Achievement as a potential mediator?. Learning and Instruction, 39, pp. 184-193.
  5. Babad, E. (2005). Guessing teachers' differential treatment of high-and low-achievers from thin slices of their public lecturing behavior. Journal of Nonverbal Behavior, 29, pp. 125-134.
  6. Bardach, L., Khajavy, G.H., Hamedi, S.M., Schober, B., & Lüftenegger, M. (2018). Student-teacher agreement on classroom goal structures and potential predictors. Teaching and Teacher Education, 74, pp. 249-260.
  7. Bardach, L., Lüftenegger, M., Yanagida, T., Schober, B., & Spiel, C. (2018). The role of within-class consensus on mastery goal structures in predicting socio-emotional outcomes. British Journal of Educational Psychology.
  8. Bardach, L., Yanagida, T., Schober, B., & Lüftenegger, M. (2018). Within-class consensus on classroom goal structures - relations to achievement and achievement goals in mathematics and language classes. Learning and Individual Differences, 67, pp. 68-90.
  9. Bergsmann, E.M., Lüftenegger, M., Jöstl, G., Schober, B., & Spiel, C. (2013). The role of classroom structure in fostering students' school functioning: A comprehensive and application-oriented approach. Learning and Individual Differences, 26, pp. 131-138.
  10. Bliese, P.D. (2000). Within-group agreement, non-independence, and reliability. Multilevel theory, research, and methods in organizations: Foundations, extension, and new directions, pp. 349-381. San Francisco: Jossey-Bass.
  11. Blumenfeld, P.C. (1992). Classroom learning and motivation: Clarifying and expanding goal theory. Journal of Educational Psychology, 84, pp. 272-281.
  12. Chen, F.F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, pp. 464-504.
  13. Cheung, G.W., & Rensvold, R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, pp. 233-255.
  14. Cleary, T.J., & Zimmerman, B.J. (2004). Self-regulation empowerment program: A school-based program to enhance self-regulated and self-motivated cycles of student learning. Psychology in the Schools, 41, pp. 537-550.
  15. Cohen, A., Doveh, E., & Eick, U. (2001). Statistical properties of the rwg(J) index of agreement. Psychological Methods, 6, pp. 297-310.
  16. Elliot, A.J. (2005). A conceptual history of the achievement goal construct. Handbook of competence and motivation, pp. 52-72. New York, NY: Guilford Press.
  17. Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford.
  18. Enders, C.K., & Bandalos, D.L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8, pp. 430-457.
  19. Epstein, J.L. (1988). Effective schools or effective students: Dealing with diversity. Policies for America's public schools: Teacher, equity and indicators, pp. 89-126. Norwood, NJ: Ablex.
  20. Fendick, F. (1990). The correlation between teacher clarity of communication and student achievement gain: A meta-analysis. Gainesville, FL: University of Florida.
  21. Ferguson, R. (2010). Student perceptions of teaching effectiveness. Boston, MA: Harvard University.
  22. Fraser, B.J. (2000). Instructional environment. Encyclopedia of psychology, pp. 308-311. New York, NY: Oxford University Press.
  23. Friedrich, A., Flunger, B., Nagengast, B., Jonkmann, K., & Trautwein, U. (2015). Pygmalion effects in the classroom: Teacher expectancy effects on students' math achievement. Contemporary Educational Psychology, 41, pp. 1-12.
  24. Good, T.L. (1987). Two decades of research on teacher expectations: Findings and future directions. Journal of Teacher Education, 38, pp. 32-47.
  25. Haertel, G.D., Walberg, H.J., & Haertel, E.H. (1981). Socio-psychological environments and learning: A quantitative synthesis. British Educational Research Journal, 7, pp. 27-36.
  26. Hattie, J. (2012). Visible learning for teachers: Maximizing impact on learning. London: Routledge.
  27. Hox, J. (2010). Multilevel analysis: Techniques and applications. Abingdon: Routledge.
  28. Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, pp. 1-55.
  29. Huck, S.W., Cormier, W.H., & Bounds, W.G. (1974). Reading statistics and research. New York: Harper and Row.
  30. Hulleman, C.S., Schrager, S.M., Bodmann, S.M., & Harackiewicz, J.M. (2010). A meta- analytic review of achievement goal measures: Different labels for the same constructs or different constructs with similar labels?. Psychological Bulletin, 136, pp. 422-449.
  31. Jehn, K.A., Chadwick, C., & Thatcher, S.M. (1997). To agree or not to agree: The effects of value congruence, individual demographic dissimilarity, and conflict on workgroup outcomes. International Journal of Conflict Management, 8, pp. 287-305.
  32. Kaplan, A., Gheen, M., & Midgley, C. (2002). The classroom goal structure and student disruptive behavior. British Journal of Educational Psychology, 72, pp. 191-211.
  33. Kaplan, A., & Maehr, M.L. (2007). The contribution and prospects of goal orientation theory. Educational Psychology Review, 19, pp. 141-184.
  34. Karabenick, S.A. (2004). Perceived achievement goal structure and college student help seeking. Journal of Educational Psychology, 96, pp. 569-581.
  35. Khajavy, G.H., Bardach, L., Hamedi, S.M., & Lüftenegger, M. (2018). Broadening the nomological network of classroom goal structures using doubly latent multilevel modeling. Contemporary Educational Psychology, 52, pp. 61-73.
  36. Klassen, R.M., & Tze, V.M.C. (2014). Teachers' self-efficacy, personality, and teaching effectiveness: A meta-analysis. Educational Research Review, 12, pp. 59-76.
  37. Kruglanksi, A.W. (1989). The psychology of being ‘right’: The problem of accuracy in social perception and cognition. Psychological Bulletin, 106, pp. 395-409.
  38. Lam, A.C., Ruzek, E.A., Schenke, K., Conley, A.M., & Karabenick, S. (2015). Student perceptions of classroom achievement goal structure: Is it appropriate to aggregate?. Journal of Educational Psychology, 107, pp. 1102-1115.
  39. Larsen, R. (2011). Missing data imputation versus full information maximum likelihood with second level dependencies. Structural Equation Modeling, 18, pp. 649-662.
  40. Lazarides, R., & Watt, H.M.G. (2015). Girls' and boys' perceived mathematics teacher beliefs, classroom learning environments and mathematical career intentions. Contemporary Educational Psychology, 41, pp. 51-60.
  41. Lindell, M.K., & Brandt, C.J. (1997). Measuring interrater agreement for ratings of a single target. Applied Psychological Measurement, 21, pp. 271-278.
  42. Lindell, M.K., & Brandt, C.J. (2000). Climate quality and climate consensus as mediators of the relationship between organizational antecedents and outcomes. Journal of Applied Psychology, 85, pp. 331-348.
  43. Lindell, M.K., Brandt, C.J., & Whitney, D.J. (1999). A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement, 23, pp. 127-135.
  44. Little, T.D. (2013). The longitudinal CFA model. Longitudinal structural equation modeling, pp. 137-179. New York, NY: Guilford.
  45. Lüdtke, O., Marsh, H.W., Robitzsch, A., & Trautwein, U. (2011). A 2x2 taxonomy of multilevel latent contextual model: Accuracy-bias trade-offs in full and partial error correction models. Psychological Methods, 16, pp. 444-467.
  46. Lüdtke, O., Robitzsch, A., Trautwein, U., & Kunter, M. (2009). Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling. Contemporary Educational Psychology, 34, pp. 120-131.
  47. Lüdtke, O., Trautwein, U., Kunter, M., & Baumert, J. (2006). Reliability and agreement of student ratings of the classroom environment: A reanalysis of TIMSS data. Learning Environments Research, 9, pp. 215-230.
  48. Lüftenegger, M., Finsterwald, M., Klug, J., Bergsmann, E., van de Schoot, R., & Schober, B. (2016). Fostering pupils' lifelong learning competencies in the classroom: Evaluation of a training programme using a multivariate multilevel growth curve approach. European Journal of Developmental Psychology, 13, pp. 719-736.
  49. Lüftenegger, M., Schober, B., Van de Schoot, R., Wagner, P., Finsterwald, M., & Spiel, C. (2012). Lifelong Learning as a goal - do autonomy and self-regulation in school result in well prepared pupils?. Learning and Instruction, 22, pp. 27-36.
  50. Lüftenegger, M., Tran, U., Bardach, L., Schober, B., & Spiel, C. (2017). Measuring a classroom mastery goal structure using the TARGET dimensions: Development and validation of a classroom goal structure scale. Zeitschrift für Psychologie, 225, pp. 64-75.
  51. Lüftenegger, M., van de Schoot, R., Schober, B., Finsterwald, M., & Spiel, C. (2014). Promotion of students' mastery goal orientations: Does TARGET work?. Educational Psychology, 34, pp. 451-469.
  52. Madjar, N., Cohen, V., & Shoval, G. (2018). Longitudinal analysis of the trajectories of academic and social motivation across the transition from elementary to middle school. Educational Psychology, 38, pp. 221-247.
  53. Marsh, H.W., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A.J.S., & Abduljabbar, A.S. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47, pp. 106-124.
  54. Marsh, H.W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44, pp. 764-802.
  55. McDonald, R.P. (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23, pp. 1-21.
  56. Meece, J.L., Anderman, E.M., & Anderman, L.H. (2006). Classroom goal structures, student motivation, and academic achievement. Annual Review of Psychology, 57, pp. 487-503.
  57. Meinhard, M.T., Brekelmans, M., & Wubbels, T. (2011). Coercive and supportive teacher behavior: Within and across-lesson associations with the classroom social climate. Learning and Instruction, 21, pp. 345-354.
  58. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, pp. 525-543.
  59. Midgley, C., Maehr, M.L., Hruda, L.Z., Anderman, E., Anderman, L., Freeman, K.E., (2000). Manual for the patterns of adaptive learning scales (PALS). Ann Arbor, MI: University of Michigan.
  60. Miller, A.D., & Murdock, T.B. (2007). Modeling latent true scores to determine the utility of aggregate student perceptions as classroom indicators in HLM: The case of classroom goal structures. Contemporary Educational Psychology, 32, pp. 83-104.
  61. Morin, A.J.S., Marsh, H.W., Nagengast, B., & Scalas, L.F. (2014). Doubly latent multilevel analyses of classroom climate: An illustration. The Journal of Experimental Education, 82, pp. 143-167.
  62. Murayama, K., & Elliot, A.J. (2009). The joint influence of personal achievement goals and classroom goal structures on achievement-relevant outcomes. Journal of Educational Psychology, 101, pp. 432-447.
  63. Muthén, B.O., & Muthén, L.K. (n.d.). Mplus (version 7.4). Los Angeles, CA: Muthén & Muthén.
  64. Nelson, P.M., & Christ, T.J. (2016). Reliability and agreement in student ratings of the class environment. School Psychology Quarterly, 31, pp. 419-430.
  65. Patrick, H., Kaplan, A., & Ryan, A. (2011). Positive classroom motivational environments: Convergence between mastery goal structure and classroom social climate. Journal of Educational Psychology, 103, pp. 367-382.
  66. Peeters, J., De Backer, F., Kindekens, A., Triquet, K., & Lombaerts, K. (2016). Teacher differences in promoting students' self-regulated learning: Exploring the role of student characteristics. Learning and Individual Differences, 52, pp. 88-96.
  67. Peterson, E.R., Rubie-Davies, C.M., Osborne, D., & Sibley, C. (2016). Teachers' explicit expectations and implicit prejudiced attitudes to educational achievement: Relations with student achievement and the ethnic achievement gap. Learning and Instruction, 42, pp. 123-140.
  68. Rosenthal, R., & Jacobson, L. (1968). Pygmalion in the classroom. New York: Holt, Rinehart & Winston.
  69. Schenke, K.C., Lam, A.S., Conley, A.M., & Karabenick, S. (2015). Adolescents' help seeking in mathematics classrooms: Relations between achievement and perceived classroom environmental influences over one school year. Contemporary Educational Psychology, 41, pp. 133-146.
  70. Schenke, K.C., Ruzek, E.A., Lam, A.S., Karabenick, S., & Eccles, J. (2017). Heterogeneity of student perceptions of the classroom climate: A latent profile approach. Learning Environments Research, 20, pp. 289-306.
  71. Schober, B., Finsterwald, M., Wagner, P., Lüftenegger, M., Aysner, M., & Spiel, C. (2007). TALK – a training program to encourage lifelong learning in school. Journal of Psychology, 215, pp. 183-193.
  72. Schweig, J. (2016). Moving beyond means: Revealing features of the learning environment by investigating the consensus among student ratings. Learning Environments Research, 19, pp. 441-462.
  73. Schwinger, M., & Stiensmeier-Pelster, J. (2011). Performance-approach and performance-avoidance classroom goals and the adoption of personal achievement goals. British Journal of Educational Psychology, 81, pp. 680-699.
  74. Seidel, T. (2006). The role of student characteristics in studying micro teaching-learning environments. Learning Environments Research, 9, pp. 253-271.
  75. Senko, C., & Dawson, B. (2017). Performance-approach goal effects depend on how they are defined: Meta-analytic evidence from multiple educational outcomes. Journal of Educational Psychology, 109, pp. 574-598.
  76. Shen, M.J., & Chen, M.C. (2007). The relationship of leadership, team trust and team performance: A comparison of the service and manufacturing industries. Social Behavior and Personality, 35, pp. 643-658.
  77. Shin, T., Davidson, M.L., & Long, J.D. (2009). Effects of missing data methods in structural equations modeling with nonnormal data. Structural Equation Modeling, 16, pp. 70-98.
  78. Urdan, T., & Midgley, C. (2003). Changes in the perceived classroom goal structure and pattern of adaptive learning during early adolescence. Contemporary Educational Psychology, 28, pp. 524-551.
  79. Uçar, F.M., & Sungur, S. (2017). The role of perceived classroom goal structures, self-efficacy, and engagement in student science achievement. Research in Science & Technological Education, 35, pp. 149-168.
  80. Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9, pp. 486-492.
  81. Wagner, W., Göllner, R., Werth, S., Voss, T., Schmitz, B., & Trautwein, U. (2016). Student and teacher ratings of instructional quality: Consistency of ratings over time, agreement, and predictive power. Journal of Educational Psychology, 108, pp. 705-721.
  82. Wittwer, J. (2008). What influences the agreement among student ratings of science instruction?. Zeitschrift für Erziehungswissenschaft, Sonderheft, 10, pp. 205-220.
  83. Wolters, C.A. (2004). Advancing achievement goal theory: Using goal structure and goal orientations to predict students' motivation, cognition and achievement. Journal of Educational Psychology, 96, pp. 236-250.
  84. Zimmerman, B.J., & Schunk, D.H. (2011). Handbook of self-regulation of learning and performance. New York, NY: Routledge.

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References