From Ten Steps to Ten themes: Consequential Contributions in the Collective Compositions of Ray C. Rist
Article Sidebar
Main Article Content
Abstract
Background: This article is part of a collection recognizing, appreciating, and celebrating the substantial lifetime evaluation contributions of Ray C. Rist.
Purpose: This article presents 10 overarching themes from the impressive body of Ray Rist’s published works.
Setting: I write as a long-time colleague of and collaborator with Ray C. Rist.
Intervention: N/a
Research design: N/a
Data Collection and Analysis: In the introductory article, the authors offered an inventory of Ray Rist’s published works, some 34 books and 159 articles and chapters. I undertook a systematic qualitative thematic analysis of those publications as an experienced qualitative analyst. I brought to the identification of themes, and their importance, my own knowledge of evaluation as an experienced evaluation practitioner, theorist, and author.
Findings: Ten overarching themes from the impressive body of Ray Rist’s published works: (1) focusing evaluation on results not just activities; (2) taking a systems perspective on M&E; (3) engaging in comparative analysis; (4) valuing methodological diversity and rigor; (5) policy evaluation as a distinct and important focus of evaluation; (6) evaluation capacity building; (7) evaluation serving and advancing social justice; (8) editing prowess as a contribution to sharpen communications and enhance evaluation use; (9) working collaboratively; and (10) addressing and synthesizing leading edge issues. This overview concludes with the challenge of transforming evaluation to evaluate transformation. Ray Rist has long been in the forefront with prescient writings spotting, identifying, and naming transformational trends with implications for evaluation.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Bemelmans-Videc, M-L., Rist, R.C., & Vedung, E.O.(Eds). (1998). Carrots, sticks, and sermons: Policy instruments and their evaluation. Transaction.
Boyle, R. & Lemaire, D. (Eds.) (1999). Building effective evaluation capacity: lessons from practice. Comparative Policy Evaluation Series. Transaction.
Chelimsky, E. (1983). The definition and measurement of evaluation quality as a management tool." Pp. 113-26 in R. G. St. Pierre (Ed.). Management and organization of program evaluation. Jossey-Bass. https://doi.org/10.1002/ev.1340 DOI: https://doi.org/10.1002/ev.1340
Derlien, H-U., Rist, R.C. (2002) Policy evaluation in international comparison. In J-E. Furubo, R. C. Rist, & R. Sandahl (Eds.) International atlas of evaluation. Transaction.
Eliadis, P., Naidoo, I.A. & Rist, R.C.(Eds.) (2023). Policy evaluation in the era of Covid-19. Routledge. https://doi.org/10.4324/9781003376316 DOI: https://doi.org/10.4324/9781003376316
Furubo, J-E, R. C. Rist & S. Speer (Eds.) (2013). Evaluation and turbulent times: reflections on a discipline in disarray. Comparative Policy Evaluation, Vol. 20. Taylor & Francis.
GAO/PEMD (1984). Designing Evaluations by R. Rist & C. Wisler (GAO/PEMD-10.1.4), Revised and reissued in 1991.
Hall, A. L. & R C. Rist (1999). Integrating multiple qualitative research methods (or avoiding the precariousness of a one-legged stool). Psychology & Marketing, 16(4), 291-304. https://doi.org/10.1002/(SICI)1520-6793(199907)16:4<291::AID-MAR2>3.0.CO;2-# DOI: https://doi.org/10.1002/(SICI)1520-6793(199907)16:4<291::AID-MAR2>3.0.CO;2-#
Houqi, H. & Rist, R.C. (2002). Evaluation capacity building in the People's Republic of China: trends and prospects. In J-E. Furubo, R. C. Rist, & R. Sandahl (Eds.) International atlas of evaluation. Transaction.
Kusek, J. Z. & Rist, R.C. (2004). Ten steps to a results-based monitoring and evaluation system: a handbook for development practitioners. World Bank.
Kusek, J. Z., Rist, R.C. & White, E. (2005). How will we know the millennium development goal results when we see them? Building a results-based monitoring and evaluation system to give us the answers. Evaluation, 11(1): 7-26. https://doi.org/10.1177/1356389005053181 DOI: https://doi.org/10.1177/1356389005053181
Mayne, J. & Rist, R. C. (2007). Studies are not enough: the necessary transformation of evaluation. Canadian Journal of Program Evaluation, 21(3), 93-120. https://doi.org/10.3138/cjpe.0021.006 DOI: https://doi.org/10.3138/cjpe.0021.006
Morra Imas, L. G. & Rist, R.C. (Eds.) (2009). Road to results: designing and conducting effective development evaluations. World Bank Publications. https://doi.org/10.1596/978-0-8213-7891-5 DOI: https://doi.org/10.1596/978-0-8213-7891-5
Morra Imas, L.& R. C. Rist (2023). What we can learn from the international program for development evaluation training (IPDET). New Directions for Evaluation, No. 177, pp. 57-64. https://doi.org/10.1002/ev.20540 DOI: https://doi.org/10.1002/ev.20540
Patton, M.Q. (2020). Blue marble evaluation. Guilford.
Patton, M.Q. (2011). Developmental evaluation. Guilford
Picciotto, R. & R. C. Rist (Eds.) (1995). Evaluation and Development. Proceedings of the 1994 World Bank conference. World Bank Operations Evaluation Department,
Rist, R. C. (1973).The urban school: a factory for failure. MIT Press.
Rist, R. C. (1976). Federal funding and social science research: the emergent transformation. Human Organization, 35(3), 263-268. https://doi.org/10.17730/humo.35.3.q625g21381104337 DOI: https://doi.org/10.17730/humo.35.3.q625g21381104337
Rist, R. C. (1978). On qualitative research: issues of design, implementation, analysis, ethics, and applicability, a bibliography. New York State College of Human Ecology Community Service Report.
Rist, R. C. (1980). Blitzkrieg ethnography: On the transformation of a method into a movement. Educational Researcher, 9(2), 8-10. https://doi.org/10.3102/0013189X009002008 DOI: https://doi.org/10.3102/0013189X009002008
Rist, R. C. (1982). Beyond the quantitative cul-de-sac: A qualitative perspective on youth employment programs. Policy Studies Journal, 10(3), 522-538. https://doi.org/10.1111/j.1541-0072.1982.tb00701.x DOI: https://doi.org/10.1111/j.1541-0072.1982.tb00701.x
Rist, R. C. (1986). Finding work: cross national perspectives on employment and training. Falmer Press.
Rist, R. C. (Ed.) (1987). Policy Studies Review Annual, Vol. 8. Transaction Publishers,
Rist, R. C. (Ed.) (1989). Policy issues for the 1990s. Policy Studies Review Annual, Vol. 9. Transaction Publishers,
Rist, R. C., (Ed.) (1989). Cross-National Perspectives on the Policy Uses (and Abuses) of Evaluation. Special issue of Knowledge in Society, 2, (4, Winter 1989-1990). https://doi.org/10.1007/BF02687229 DOI: https://doi.org/10.1007/BF02687229
Rist, R. C., (Ed.) (1990). Program evaluation and the management of government. Transaction.
Rist, R. C. (Ed.) (1994a). The democratic imagination: dialogues on the work of Irving Louis Horowitz. Transaction Books.
Rist, R. C. (1994b, 2003). Influencing the policy process with qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research. Sage.
Rist, R. C. (Ed.) (1995). Policy evaluation: linking theory to practice. The International library of comparative public policy. Elgar Pub. Co.
Rist, R. C. (2015a). Postscript: Development questions and evaluation answers. New Directions for Evaluation. No. 67, 167-174. https://doi.org/10.1002/ev.1014 DOI: https://doi.org/10.1002/ev.1014
Rist, R.C. (2006). The "E" in monitoring and evaluation-- Using evaluative knowledge to support a results-based management system. Pp. 3-22 in R. C. Rist & N. Stame (Eds.) From studies to streams managing evaluative systems. Transaction Books. https://doi.org/10.4324/9780203791189-1 DOI: https://doi.org/10.4324/9780203791189-1
Rist, R.C. (2011). On the application of qualitative research to the policy process: an emergent linkage. In L. Barton (Ed.) Social crisis and educational research. Taylor & Francis.
Rist, R. C. (2013). Evaluation and turbulence: beyond an incremental view of the world. Pp. 255-262 in Furubo J-E., Rist, R. C. & Speer, S. (Eds.) Evaluation and turbulent times: reflections on a discipline in disarray. Comparative Policy Evaluation, Vol. 20. Taylor & Francis. https://doi.org/10.1596/978-0-8213-9879-1 DOI: https://doi.org/10.4324/9781351296649-13
Rist, R. C. & Anson, R.J. (Eds.) (1977). On the shaping of educational policy: the transition from administrative/political to judicial decision-making. In Rist, R. C. & Anson R. J. (Eds.), Education, social science, and the judicial process. Teachers College Press.
Rist, R.C., Boily, M-H & Martin, F.R. (Eds.) (2011). Influencing change: building evaluation capacity to strengthen governance. World Bank. https://doi.org/10.1596/978-0-8213-8403-9 DOI: https://doi.org/10.1596/978-0-8213-8403-9
Rist, R.C., Boily, M-H & Martin, F.R. (Eds.) (2013) Development evaluation in times of turbulence: dealing with crises that endanger our future. World Bank Group https://doi.org/10.1596/978-0-8213-9879-1 DOI: https://doi.org/10.1596/978-0-8213-9879-1
Rist, R.C. & Johnson, P.L. (1991). The IIAS working group on policy and program evaluation. Evaluation Practice, 12 (1), pp.45-53. https://doi.org/10.1177/109821409101200107 DOI: https://doi.org/10.1177/109821409101200107
Rist, R. C. & Joyce, M.K. (1995). Qualitative research and implementation evaluation: A path to organizational learning. International Journal of Educational Research, 23(2), 127-136. https://doi.org/10.1016/0883-0355(95)91497-5 DOI: https://doi.org/10.1016/0883-0355(95)91497-5
Rist, R.C. & Stame, N. (2006). From studies to streams managing evaluative systems. Comparative Policy Evaluation, Vol. 12. Transaction.
Van den Berg, R., Magro C. & Adrien, M-H. (Eds.) (2021). Transformational Evaluation for the Global Crises of Our Times. International Development Evaluation Association (IDEAS), Exeter, UK.