A Critical-Historical Review of Program Evaluation and the Emerging Motif ‘Evaluation Science’
Main Article Content
Abstract
Background: It is important to distinguish between evaluation as an inherent, automatic, affective process and Program Evaluation (Evaluation, with capitalised ‘E’) as an institution, and equally important to consider what a good understanding of evaluation tells us about Evaluation. Evaluation is an established social institution whose modern roots can be traced back to 16th century France. Since the early 1900s the institution has developed within and across a range of scientific disciplines with interests in perceived social problems and efforts to resolve the said problems. This can be demonstrated objectively by the number and scale of relevant publications within relevant disciplines. This, in turn, helps us understand more about Evaluation as an institution. Set in this context is the question of Evaluation Science: is this simply a fashionable institutional motif or is it a potential new era for Evaluation?
Purpose: Commentary on the history and development of Program Evaluation.
Setting: Not applicable.
Intervention: Not applicable.
Research design: Not applicable.
Data collection & analysis: Not applicable.
Findings: Not applicable.
Keywords: program evaluation; evaluation; history; evaluation science.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Ayob, A. H. and Morell, J. A. (2016). The historical path of evaluation as reflected in the content of Evaluation and Program Planning. Evaluation and Program Planning. https://doi.org/10.1016/j.evalprogplan.2016.05.006 DOI: https://doi.org/10.1016/j.evalprogplan.2016.05.006
Chilisa, B. (2015). A Synthesis Paper on the Made in Africa Evaluation Concept. African Evaluation Association. https://afrea.org/wp-content/uploads/2018/06/MAE2-Final-31st-august.pdf. Accessed December 2019
DiMaggio, P. J. and Powell, W. W. (1991). Introduction. In P. J. DiMaggio and W. Powell (eds.) The New Institutionalism and Organizational Analysis, pp. 1-38. Chicago: University of Chicago Press.
Ferguson, M. and Bargh, J. (2008). The Constructive Nature of Automatic Evaluation, in Musch, J. and Klauer, KC. (Eds.) (2008). The Psychology of Evaluation: Affective Processes. In Cognition and Emotion. Mahwah, N.J.; London: Lawrence Erlbaum Associates, 2003; 2008. Pgs. 173-194.
Fingerhut J. and Prinz JJ. (2018) Grounding evaluative concepts. Phil.Trans. R. Soc. B. 373 https://doi.org/10.1098/rstb.2017.0142 DOI: https://doi.org/10.1098/rstb.2017.0142
Gordon, G. and Morse EV. (1975). Evaluation Research. Annual Review of Sociology, 339-362. https://doi.org/10.1146/annurev.so.01.080175.002011 DOI: https://doi.org/10.1146/annurev.so.01.080175.002011
Gerth, H. H. and Mills, C. W. (1953). Character and Social Structure: The psychology of social institutions. Harcourt, Brace and Company. New York.
Hogan, R. L. (2007). The Historical development of Program Evaluation: Exploring the past and present. Online Journal of Workforce Education and Development, Volume II, Issue 4.
Judd, C. H. (1936; 1926). The Psychology of Social Institutions. The Macmillan Company. New York. https://doi.org/10.1037/10971-000 DOI: https://doi.org/10.1037/10971-000
Kantor, J. R. (1919). Psychology as a science of critical evaluation. Psychological Review, 26(1), 1-15. https://doi.org/10.1037/h0074274 https://doi.org/10.1037/h0074274 DOI: https://doi.org/10.1037/h0074274
King, J. A. and Alkin, M. C. (2016). The historical development of evaluation use. American Journal of Evaluation, 37(4), 568-579. https://doi.org/10.1177/1098214016665164 DOI: https://doi.org/10.1177/1098214016665164
King, J. A. and Alkin, M. C. (2019). The Centrality of use: Theories of evaluation use and influence and thoughts on the first 50 years of use research. American Journal of Evaluation, 40(3), 431-458. https://doi.org/10.1177/1098214018796328 DOI: https://doi.org/10.1177/1098214018796328
Musch, J. and Klauer, KC. (Eds.) (2008). The Psychology of Evaluation: Affective Processes in Cognition and Emotion. Mahwah, N.J.; London: Lawrence Erlbaum Associates, 2003; 2008. https://doi.org/10.4324/9781410606853 DOI: https://doi.org/10.4324/9781410606853
Nobel Prize for Economics 2019. https://www.nobelprize.org/prizes/economic-sciences/2019/press-release/. Accessed November 2019.
Office of Evaluation Sciences. https://oes.gsa.gov/about/ Accessed November 2019.
Olson, S. (Rapporteur) (2014). Evolving Methods in Evaluation Science. In, Evaluation Design for Complex Global Initiatives. National Academies Press
Washington, DC. Chapter 9, pgs. 79-86. https://www.nap.edu/read/18739/chapter/10 Accessed December 2019
Patton, M. (2008). Evaluation Science. American Journal of Evaluation 2018, Vol. 39(2) 183-200. https://doi.org/10.1177/1098214018763121 DOI: https://doi.org/10.1177/1098214018763121
Programme Evaluation Organization. http://planningcommission.gov.in/reports/peoreport/peo/peoabout.htm. Accessed November 2019.
Program Evaluation and Review Technique. https://en.wikipedia.org/wiki/Program_evaluation_and_review_technique. Accessed November 2019/
Regulatory Focus (2019). OND Reorganization Continues Apace, Posted 25 November 2019 By Zachary Brennan. https://www.raps.org/news-and-articles/news-articles/2019/11/ond-reorganization-continues-apace Accessed December 2019
Rossi, P. (1990). Forward. In H T Chen (Ed.), Theory Driven Evaluations. Newbury Park, CA: Sage.
Scott, W. R. (1995). Institutions and Organizations. Thousand Oaks, CA: Sage.
Scott, W. R. (2004). Institutional theory. in Encyclopaedia of Social Theory, George Ritzer, ed. Thousand Oaks, CA: Sage. Pp. 408-14
Scriven, M. (1973). "Goal-free evaluation". School evaluation: 319-328.
Scriven, M. (2007). The Logic of Evaluation. In H.V. Hansen, et. al. (Eds), Dissensus and the Search for Common Ground, CD-ROM (pp. 1-16). Windsor, ON: OSSA.
Tharp, R. G. & Gallimore, R. (1979). The ecology of program research and development: A model of evaluation succession. In: L. B. Sechrest (Ed.), Evaluation Studies Review Annual, Vol. 4., 39-60. Beverly Hills, CA: Sage Publications.
The Programs Evaluation Office. https://en.wikipedia.org/wiki/Programs_Evaluation_Office. Accessed November 2019.
Trochim, WMK. (1998). An Evaluation of Michael Scriven's "Minimalist Theory: The Least Theory that Practice Requires". American Journal of Evaluation, 19 (2), 243-249. https://doi.org/10.1016/S1098-2140(99)80202-1 DOI: https://doi.org/10.1016/S1098-2140(99)80202-1
Weber, M. (1949). On the methodology of the social sciences. Translated and Edited by Edward A. Shils and Henry A. Finch. The Free Press of Glencoe, Illinois. (Chap 1 and 2 particularly).
White, L., Barque-Duran, A. and Pothos, E. (2016) An investigation of a quantum probability model for the constructive effect of affective evaluation. Philosophical Transactions of the Royal Society A. 374 https://doi.org/10.1098/rsta.2015.0142 DOI: https://doi.org/10.1098/rsta.2015.0142
Winkielman, P., Schwarz, N., Fazendeiro, T. and Reber, R. (2008). The Hedonic Marking of Processing Fluency: Implications for Evaluative Judgment. In Musch, J. and Klauer, KC. (Eds.) (2008). The Psychology of Evaluation: Affective Processes in Cognition and Emotion. Mahwah, N.J.; London: Lawrence Erlbaum Associates, 2003; 2008. Pgs. 195-225.
Zuckerman, H. and Merton, RK. (1971). Patterns of evaluation in science: Institutionalisation, structure and functions of the referee system. Minerva 9:66-100. https://doi.org/10.1007/BF01553188 DOI: https://doi.org/10.1007/BF01553188