Using Strong Evaluation Designs in Developing Countries: Experience and Challenges
Main Article Content
Abstract
In his article in the November 2006 JMDE, Thomas Cook reviewed the current debate on the role of randomized control trials (RCT). While his article focused on educational research, the issues raised, and the responses by Michael Scriven (2006) and Jane Davidson (2006), highlighted the broader issues currently being debated on the need for more ‘rigorous’ program evaluation in all sectors. The purpose of this article is to extend the discussion to the field of international development evaluation, reviewing the different approaches which can be adopted to rigorous evaluation methodology and their applicability in a development setting.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Alkire, S. (2002). Valuing freedom: Sen's capability approach and poverty reduction. Oxford: Oxford University Press. DOI: https://doi.org/10.1093/0199245797.001.0001
https://doi.org/10.1093/0199245797.001.0001
Alsop, R., Bertelsen, M., & Holland, J. (2006). Empowerment in practice: from analysis to implementation. Washington, DC: World Bank. DOI: https://doi.org/10.1596/978-0-8213-6450-5
https://doi.org/10.1596/978-0-8213-6450-5
Bamberger, M., Rugh, J., & Mabry, L. (2006). Realworld evaluation: Working under budget, time, data and political constraints. Thousand Oaks, CA: Sage.
Bamberger, M. (2006). Conducting quality impact evaluations under budget, time and data constraints. Washington DC: World Bank.
Carvalho, S & White, H (2004) "Theory-based Evaluation: the Case of Social Funds" American Journal of Evaluation 25(2):141- 60. DOI: https://doi.org/10.1177/109821400402500202
https://doi.org/10.1177/109821400402500202
Chambers, R. (1994a) "The origins and practice of participatory rural appraisal" World Development 22(7): 953-969. DOI: https://doi.org/10.1016/0305-750X(94)90141-4
https://doi.org/10.1016/0305-750X(94)90141-4
Chambers, R. (1994b) "Participatory rural appraisal: analysis of experience" World Development 22(7): 1253-1268. DOI: https://doi.org/10.1016/0305-750X(94)90003-5
https://doi.org/10.1016/0305-750X(94)90003-5
Chambers, R. (1994c) "Participatory rural appraisal: challenges, potentials and paradigm" World Development 22(7): 1437- 145. DOI: https://doi.org/10.1016/0305-750X(94)90030-2
https://doi.org/10.1016/0305-750X(94)90030-2
CGD. (2006). When will we ever learn? Improving lives through impact evaluation. Washington, DC: Center for Global Development.
Cook, T. D. (2006) Describing what is special about the role of experiments in contemporary educational research: Putting the "gold standard" rhetoric into perspective. Journal of MultiDisciplinary Evaluation, 6, 1-7. DOI: https://doi.org/10.56645/jmde.v3i6.36
https://doi.org/10.56645/jmde.v3i6.36
Davidson, E. J. (2006). The RCTs-only doctrine: Brakes on the acquisition of knowledge? Journal of MultiDisciplinary Evaluation, 6, ii-v. DOI: https://doi.org/10.56645/jmde.v3i6.35
https://doi.org/10.56645/jmde.v3i6.35
Deaton, A. (2005) "Measuring Poverty in a Growing World (or Measuring Growth in a Poor World)" Review of Economics and Statistics 87(1):1-19. DOI: https://doi.org/10.1162/0034653053327612
https://doi.org/10.1162/0034653053327612
Duflo, E., & Kremer, M. (2005). Use of randomization in the evaluation of development effectiveness. In G. K. Pitman, O. Feinstein, & G. Ingram (Eds.), Evaluating development effectiveness. Washington, DC: World Bank.
Gupta Kapoor, A. (2002). Review of impact evaluation methodologies used by the Operations Evaluation Department over past 25 years [OED Working Paper]. Washington, DC: IEG, World Bank.
Kabeer, N. (1992). Evaluating cost-benefit analysis as a tool for gender planning. Development and Change, 23. DOI: https://doi.org/10.1111/j.1467-7660.1992.tb00448.x
https://doi.org/10.1111/j.1467-7660.1992.tb00448.x
Krishna, A. (2002). Active social capital: Tracing the roots of development and democracy. University Presses of California, Columbia and Princeton. DOI: https://doi.org/10.7312/kris12570
https://doi.org/10.7312/kris12570
Krishna, A., Kapila, M., Porwal, M., & Singh, V. (2005). Why growth is not enough: Household poverty dynamics in Northeast Gujarat, India. Journal of Development Studies, 41(7), 1163-1192. DOI: https://doi.org/10.1080/00220380500170865
https://doi.org/10.1080/00220380500170865
Kumar, S. (2002). Methods for community participation: A complete guide for practitioners. Rugby, England: ITDG Publishing.
Morduch, J. (1998). Does microfinance really help the poor? New evidence from flagship program in Bangladesh. Princeton, NJ: Princeton University.
Scriven, M. (2006). Converting perspective to practice. Journal of MultiDisciplinary Evaluation, 6, 8-9. DOI: https://doi.org/10.56645/jmde.v3i6.37
https://doi.org/10.56645/jmde.v3i6.37
Weiss, C (2000). "Which Links in which Theories Shall We Evaluate?" Pp 35-45 in Program Theory in Evaluation: Challenges and Opportunities edited by P.J Rogers et al. New Directions for Evaluation. No. 87 San Francisco. Jossey-Bass. DOI: https://doi.org/10.1002/ev.1180
https://doi.org/10.1002/ev.1180
White, H. (2004). Using development goals and targets for donor agency performance measurement. In R. Black & H. White (Eds.), Targeting development: Critical perspectives on the Millennium Development Goals. London: Routledge. DOI: https://doi.org/10.4324/9780203403235.ch3
https://doi.org/10.4324/9780203403235.ch3
White, H. (2006). Impact evaluation experience of the Independent Evaluation Group of the World Bank. Washington, DC: World Bank.
World Bank. (1999). Agricultural extension: The Kenya experience. Washington, DC: World Bank.
World Bank. (2002). Social funds: Assessing the effectiveness. Washington, DC: World Bank. World Bank. (2004). Books, buildings and learning outcomes: An impact evaluation of World Bank assistance to basic education in Ghana. Washington, DC: World Bank.
World Bank. (2005). Maintaining momentum to 2015? An impact evaluation of interventions to improve maternal and child health and nutrition outcomes in Bangladesh. Washington, DC: World Bank.