Revisiting and Expanding Scriven's Fallacies About Formative and Summative Evaluation
Article Sidebar
Main Article Content
Abstract
This article outlines the origins of the formative and summative evaluation and then revisits Scriven’s claims about eight fallacies. We add to seven further fallacies especially that there are such concepts as formative and summative assessment. The argument is to return to Scriven’s original claims that formative relates to improvement and summative relates to status, the primary purpose of formative evaluation is to stimulate summative evaluation, and both demand rigor and must lead to claims about merit, worth or significance.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Black, P., & Wiliam, D. (1998a). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74. https://doi.org/10.1080/0969595980050102 DOI: https://doi.org/10.1080/0969595980050102
Black, P., & Wiliam, D. (1998b). Inside the black box: Raising standards through classroom assessment. Granada Learning.
Black, P., & Wiliam, D. (2003). 'In praise of educational research': Formative assessment. British Educational Research Journal, 29(5), 623-637. https://doi.org/10.1080/0141192032000133721 DOI: https://doi.org/10.1080/0141192032000133721
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21, 5-31. https://doi.org/10.1007/s11092-008-9068-5 DOI: https://doi.org/10.1007/s11092-008-9068-5
Black, P., & Wiliam, D. (2010). Inside the black box: Raising standards through classroom assessment. Phi delta kappan, 92(1), 81-90. https://doi.org/10.1177/003172171009200119 DOI: https://doi.org/10.1177/003172171009200119
Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 551-575. https://doi.org/10.1080/0969594X.2018.1441807 DOI: https://doi.org/10.1080/0969594X.2018.1441807
Bloom, B. S. (1968). Learning for mastery. Evaluation Comment (UCLA-CSIEP), 1(2), 1-12.
Bloom, B. S., Madaus, G. F., & Hastings, J. T. (1971). Handbook on formative and summative evaluation of student learning. McGraw-Hill
Booth, N. (2017, July 9). What is formative assessment, why hasn't it worked in schools, and how can we make it better in the classroom? Impact. https://my.chartered.college/impact_article/what-is-formative-assessment-why-hasnt-it-worked-in-schools-and-how-can-we-make-it-better-in-the-classroom/
Chen, H. T. (1996). A comprehensive typology for program evaluation. Evaluation Practice, 17(2), 121-130. https://doi.org/10.1177/109821409601700204 DOI: https://doi.org/10.1016/S0886-1633(96)90017-3
Cizek, G. J. (1996). Learning, achievement, and assessment: Constructs at a crossroads. In G. D. Phye (Ed.), Handbook of classroom assessment (pp. 1-32). Academic Press. https://doi.org/10.1016/B978-012554155-8/50003-X DOI: https://doi.org/10.1016/B978-012554155-8/50003-X
Cizek, G. J., Andrade, H. L., & Bennett, R. E. (2019). Formative assessment: History, definition and progress. In H. L. Andrade, R. E. Bennett, & G. C. Cizek (Eds.), Handbook of formative assessment in the disciplines. Routledge. https://doi.org/10.4324/9781315166933-1 DOI: https://doi.org/10.4324/9781315166933
Clinton, J. M., Aston, R., & Paproth, H. (2023, November). Enhancing teaching practices: The power of evaluative thinking for teachers, school and system leaders [Symposium]. Australia Association for Research in Education, Melbourne, Australia.
Cronbach, L.J. (1963). Evaluation for course improvement. In R.W. heath (Ed.), New curricula. Harper & Row.
Cronbach, L.J. (1964). Learning research and curriculum development. Journal of Research in Science Teaching, 2(3), 204-207. https://doi.org/10.1002/tea.3660020309 DOI: https://doi.org/10.1002/tea.3660020309
Cronbach, L.J. (1983). Desiging evauations of educational and social programs. Jossey-Bass.
Cronbach, L. J., & Suppes, P. (1969). Research for tomorrow's schools: Disciplined inquiry for education. McMillan.
Cronbach, L. J., & Suppes, P. (1969). Research for tomorrow's schools: Disciplined inquiry for education. Macmillan.
Dolin, J., Black, P., Harlen, W., & Tiberghien, A. (2018). Exploring relations between formative and summative assessment. In J. Dolin & R. Evans (Eds.), Transforming assessment: Through an interplay between practice, research and policy (pp. 53-80). Springer. https://doi.org/10.1007/978-3-319-63248-3_3 DOI: https://doi.org/10.1007/978-3-319-63248-3_3
Dunn, K. E., & Mulvenon, S. W. (2019). A critical review of research on formative assessments: The limited scientific evidence of the impact of formative assessments in education. Practical Assessment, Research, and Evaluation, 14(1), 7.
Gipps, C. (1994). Developments in educational assessment: What makes a good test?. Assessment in Education: Principles, Policy & Practice, 1(3), 283-292. https://doi.org/10.1080/0969594940010304 DOI: https://doi.org/10.1080/0969594940010304
Guskey, T. R. (2010). Formative assessment: The contributions of Benjamin S. Bloom. In H. Andrade & G. J. Cizek (Eds.), Handbook of formative assessment (pp. 106-124). Routledge.
Hager, P., & Butler, J. (1996). Two models of educational assessment. Assessment & Evaluation in Higher Education, 21(4), 367-378. https://doi.org/10.1080/0260293960210407 DOI: https://doi.org/10.1080/0260293960210407
Hattie, J. A. C., Brown, G. T., & Keegan, P. (2005). A national teacher-managed, curriculum-based assessment system: Assessment Tools for Teaching & Learning (asTTle). International Journal of Learning, 10, 770-778.
Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.
Hattie, J. (2023). Visible learning: The sequel: A synthesis of over 2,100 meta-analyses relating to achievement. Routledge. https://doi.org/10.4324/9781003380542 DOI: https://doi.org/10.4324/9781003380542
Lau, A. M. S. (2016). 'Formative good, summative bad?'A review of the dichotomy in assessment literature. Journal of Further and Higher Education, 40(4), 509-525. https://doi.org/10.1080/0309877X.2014.984600 DOI: https://doi.org/10.1080/0309877X.2014.984600
McMorran, C., Ragupathi, K., & Luo, S. (2017). Assessment and learning without grades? Motivations and concerns with implementing gradeless learning in higher education. Assessment & Evaluation in Higher Education, 42(3), 361-377. https://doi.org/10.1080/02602938.2015.1114584 DOI: https://doi.org/10.1080/02602938.2015.1114584
Paproth, H., Clinton, J. M., & Aston, R. (2023). The role of evaluative thinking in the success of schools as community hubs. In B. Cleveland, S. Backhouse, P. Chandler, I. McShane, J. M. Clinton, & C. Newton (Eds.), Schools as Community Hubs. Springer. https://doi.org/10.1007/978-981-19-9972-7_21 DOI: https://doi.org/10.1007/978-981-19-9972-7_21
Popham, W. J. (2006, September). Defining and enhancing formative assessment [Paper presentation]. Annual Large-Scale Assessment Conference of the Council of Chief State School Officers, San Francisco, CA, United States.
Schwandt, T. A. (2018). Evaluative thinking as a collaborative social practice: The case of boundary judgment making. New Directions for Evaluation, 158, 125-137. https://doi.org/10.1002/ev.20318 DOI: https://doi.org/10.1002/ev.20318
Scriven., M. (1967). The methodology of evaluation. In R. W. Tyler (ed.),Perspective of Curriculum Evaluation, American Educational Research Association (AERA), Monograph of Curriculum Evaluation, No. 1., Chicago: Read Mc. Nally.
Scriven, M. (1973). Goal-free evaluation. In E. R. House (Ed.), School evaluation: The politics and process (pp. 319-328). McCutchan.
Scriven, M. (1991). Chapter II: Beyond formative and summative evaluation. Teachers College Record, 92(6), 19-64. https://doi.org/10.1177/016146819109200603 DOI: https://doi.org/10.1177/016146819109200603
Scriven, M. (1993). The nature of evaluation. New Directions for Program Evaluation, 58, 5. https://doi.org/10.1002/ev.1640 DOI: https://doi.org/10.1002/ev.1640
Scriven, M. (1996). Types of evaluation and types of evaluator. Evaluation Practice, 17(2), 151-161. https://doi.org/10.1177/109821409601700207 DOI: https://doi.org/10.1177/109821409601700207
Scriven, M. (2010). In Donaldson, S. I., Patton, M. Q., Fetterman, D., & Scriven, M. (2010). The 2009 Claremont debates: The promise and pitfalls of utilization-focused and empowerment evaluation. Journal of Multidisciplinary Evaluation, 6(13), 15-57. https://doi.org/10.56645/jmde.v6i13.260 DOI: https://doi.org/10.56645/jmde.v6i13.260
Scriven, M. (2012). The logic of valuing. New Directions for Evaluation, 2012(133), 17-28. https://doi.org/10.1002/ev.20003 DOI: https://doi.org/10.1002/ev.20003
Scriven, M. (2013). Evaluation as a paradigm for educational research. In E. R. House (Ed.), New directions in educational evaluation (pp. 53-67). Routledge.
Shepard, L. A. (2000). The role of assessment in a learning culture. Educational researcher, 29(7), 4-14. https://doi.org/10.3102/0013189X029007004 DOI: https://doi.org/10.3102/0013189X029007004
Wiliam, D. [@dylanwiliam]. (2013, October 23). Example of a really big mistake: Calling formative assessment formative assessment and not something like "responsive teaching". X [formerly Twitter]. https://twitter.com/dylanwiliam/status/393045049337847808