What Is This Thing Called Evaluation Theory?
DOI:
https://doi.org/10.56645/jmde.v20i48.1037Keywords:
evaluation theory, data visualization, research on evaluation, teaching evaluationAbstract
Background: Evaluation theory has and continues to play an important role in the practice and profession of evaluation. Over the years, and as the range of evaluation theories has continued to grow, evaluation scholars and practitioners have developed various visualized classification frameworks of evaluation theory, invoking images such as trees, rivers, the periodic table, metro maps, concept maps, and most recently gardens.
Purpose: The purpose of this special issue is to explore different visualizations of evaluation theory and to discuss their benefits and implications for the practice and profession of evaluation.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: Not applicable.
Downloads
References
Abbott, A. D., & Abbott, D. (2004). Methods of discovery: Heuristics for the social sciences. W.W. Norton & Company.
Alkin, M. C. (2004). Evaluation roots: Tracing theorists’ views and influences. Sage Publications. https://doi.org/10.4135/9781412984157
Alkin, M. C. (2013). Evaluation roots: A wider perspective of theorists’ views and influences. Sage Publications.
Alkin, M. C., & Christie, C. A. (2023). Evaluation roots: Theory influencing practice. Sage Publications.
Alkin, M., & Ellett, F. (1985). Evaluation models and their development. In T. Husén & T. N. Postlethwaite (Eds.), International encyclopedia of education: Research and studies. Pergamon Press.
Alkin, M. C., & House, E. (1992). Evaluation of programs. In M. C. Alkin (ed.), Encyclopedia of educational research. Macmillan.
American Evaluation Association. (2018). AEA evaluator competencies. https://www.eval.org/About/Competencies-Standards/AEA-Evaluator-Competencies
Azzam, T., & Donaldson, S. I. (2012). The evaluation purposes visualization. Unpublished manuscript.
Azzam, T., & Donaldson, S. I. (2013). The evaluation purposes visualization. Unpublished manuscript.
Bledsoe, K. L., & Graham, J. A. (2005). The use of multiple evaluation approaches in program evaluation. American Journal of Evaluation, 26(3), 302–319. https://doi.org/10.1177/1098214005278749
Boyce, A. S., & McGowan, B. L. (2019). An exploration of two novice evaluation educators’ experiences developing and implementing introduction to evaluation courses. American Journal of Evaluation, 40(1), 119–136. https://doi.org/10.1177/1098214018778812
Christie, C. A. (2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. New Directions for Evaluation, 97(1), 7–36. https://doi.org/10.1002/ev.72
Christie, C. A., & Alkin, M. (2004). An evaluation theory tree. In M. Alkin (Ed.), Evaluation roots (pp. 12–66). Sage Publications.
Christie, C. A., & Lemire, S. T. (2019). Why evaluation theory should be used to inform evaluation policy. American Journal of Evaluation, 40(4), 490–508. https://doi.org/10.1177/1098214018824045
Coryn, C. L., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011). A systematic review of theory-driven evaluation practice from 1990 to 2009. American Journal of Evaluation, 32(2), 199–226. https://doi.org/10.1177/1098214010389321
Dewey, J. D., Montrosse, B. E., Schröter, D. C., Sullins, C. D., & Mattox, J. R. (2008). Evaluator competencies: What’s taught versus what’s sought. American Journal of Evaluation, 29(3), 268–287. https://doi.org/10.1177/1098214008321152
Donaldson, S. I., & Lipsey, M. W. (2006). Roles for theory in evaluation practice. In I. Shaw, J.
Greene, & M. Mark (Eds.), Handbook of Evaluation (pp.56–75). Sage Publications.
European Evaluation Society. (2011). The EES evaluation capabilities framework. https://europeanevaluation.org/wp-content/uploads/2020/03/The-EES-Evaluation-Capabilities-Framework-leaflet.pdf
Fetterman, D. M. (1994). Steps of empowerment evaluation: From California to Cape Town. Evaluation and Program Planning, 17(3), 305–313. https://doi.org/10.1016/0149-7189(94)90010-8
Fitzpatrick, J. L., Worthen, B. R., Sanders, J. R., & Wingate, L. A. (2023). Program evaluation: Alternative approaches and practical guidelines (5th ed.). Allyn and Bacon.
Galport, N., & Azzam, T. (2017). Evaluator Training Needs and Competencies: A Gap Analysis. American Journal of Evaluation, 38(1), 80–100. https://doi.org/10.1177/1098214016643183
Glass, G. V., & Ellett, F. S. (1980). Evaluation research. Annual Review of Psychology, 31, 211–228. https://doi.org/10.1146/annurev.ps.31.020180.001235
House, E. R. (1978). Assumptions underlying evaluation models. Educational Researcher, 7(3), 4–12. https://doi.org/10.3102/0013189X007003004
Lee, J., LeBaron Wallace, T., & Alkin, M. (2007). Using problem-based learning to train evaluators. American Journal of Evaluation, 28(4), 536–545. https://doi.org/10.1177/1098214007305613
Lemire, S. (2020). The evaluation metro map. Unpublished manuscript.
Lemire, S., Peck, L. R., & Porowski, A. (2020). The growth of the evaluation tree in the policy analysis forest: Recent developments in evaluation. Policy Studies Journal, 48(S1), S47–S70. https://doi.org/10/ghdjc2
Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice: A comprehensive guide. The Guilford Press.
Mertens, D. M., & Wilson, A. T. (2018). Program evaluation theory and practice. Guilford Publications.
Montrosse-Moorhead, B., Gambino, A. J., Yahn, L. M., Fan, M., & Vo, A. T. (2022). Evaluator education curriculum: Which competencies ought to be prioritized in Master’s and Doctoral programs? American Journal of Evaluation, 43(2), 269–292. https://doi.org/10.1177/10982140211020326
Montrosse-Moorhead, B., Schröter, D., & Becho, L. W. (2024). The garden of evaluation approaches. American Journal of Evaluation, 0(0). https://doi.org/10.1177/10982140231216667
Moss, P. A., & Haertel, E. H. (2016). Engaging methodological pluralism. Handbook of research on teaching, 5, 127–247. https://doi.org/10.3102/978-0-935302-48-6_3
Oxford University Press (2023a, September). Theory (n., sense 3). In Oxford English Dictionary. https://doi.org/10.1093/OED/1108604610.
Oxford University Press (2023b, December). Approach (n., sense 5b). In Oxford English Dictionary. https://doi.org/10.1093/OED/3442162913.
Oxford University Press (2023c, December). Model (n., sense II.10). In Oxford English Dictionary. https://doi.org/10.1093/OED/3160470348.
Patton, M. Q. (1978). Utilization-focused evaluation. Sage Publications.
Pawson, R., & Tilley, N. (1997). Realistic evaluation. Sage Publications.
Popham, W. J. (1975). Educational evaluation. Hall Press.
Quadrant Conseil, Strategic Design Scenarios (2022). Impact Evaluation. A map of uses. Agence française de développement. https://www.afd.fr/sites/afd/files/2023-01-04-20-43/impact-evaluation-map-uses.pdf
Rogers, E. M. (1962). Diffusion of innovations. Free Press.
Scriven, M., & Davidson, E. J. (2021, November 12). The transscientific theory of evaluation [Paper presentation]. American Evaluation Association Annual Conference. https://evaluation.secure-platform.com/a/gallery/rounds/1/schedule/items/1242
Shadish, W. R. (1998). Evaluation theory is who we are. American Journal of Evaluation, 19(1), 1–19. https://doi.org/10.1177/109821409801900102
Shadish, W. R., Jr., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation: Theories of practice. Sage Publications.
Stufflebeam, D. L., & Coryn, C. L. (2014). Evaluation theory, models, and applications (2nd ed.). John Wiley & Sons.
UK Evaluation Society. (2012). Framework of evaluation capabilities. https://www.evaluation.org.uk/app/uploads/2019/04/UK-Evaluation-Society-Framework-of-Evaluation-Capabilities.pdf
United Nations Evaluation Group. (2016). UNEG evaluation competency framework. https://www.unevaluation.org/document/download/2610
UNEG Working Group on Evaluation Methods. (2020). Compendium of evaluation methods reviewed (Vol. 1). United Nations Evaluation Group. http://www.unevaluation.org/document/detail/2939
Vaca, S. (2017). Periodic table of evaluation. Retrieved November 22, 2017, from https://twitter.com/VisualBrains/status/933239046658187265
Wholey, J. S. (1987). Evaluability assessment: developing program theory. New Directions for Program Evaluation, 33, 77–92. Jossey-Bass. https://doi.org/10.1002/ev.1447
Worthen, B. W., & Sanders, J. R. (1973). Educational evaluation: Theory and practice. C. A. Jones Publishing Company.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Sebastian Lemire, Bianca Montrosse-Moorhead, Christina Christie
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
