Equity Implications in Evaluating Development Aid: The Italian Case
Main Article Content
Abstract
Background: In the field of development aid, social equity is an emerging issue that concerns the evaluation community in its theoretical and practical dimensions.
Purpose: A widely held belief is that evaluators do not apply theory. In this paper, we intend to verify this statement about equity in the field of cooperation projects.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: We considered equity-focused approaches and found three common factors: stakeholder participation, attention to context, and focus on marginalized groups. These elements operate as screening criteria in identifying equity issues in a case study.
Data Collection and Analysis: The paper examines a practical experience of Italian cooperation. This involved a review of evaluations reports completed between 2013 and 2014. The reports are analyzed according to the three screening criteria.
Findings: The use of the three criteria has proved its worth in grasping the issues of equity neglected and often not recognized in reports. Once again a gap emerges between theory and practice. The availability of theoretical approaches is not sufficient. The paper, therefore, proposes a reflection on the responsibility of evaluation towards social justice.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Abma, T. A. (2006). The practice and politics of responsive evaluation. American Journal of Evaluation, 27(1), 31-43. https://doi.org/10.1177/1098214005283189 DOI: https://doi.org/10.1177/1098214005283189
Agrawal, R. & Rao, B. (2015). Evaluations as catalysts in bridging developmental inequalities. In R. Rist, F. P. Martin, & A. M. Fernandez (Eds), Poverty, inequality, and evaluation: Changing perspectives (pp. 24-38). Washington, DC: World Bank Group. https://doi.org/10.1596/978-1-4648-0703-9_ch2 DOI: https://doi.org/10.1596/978-1-4648-0703-9_ch2
American Evaluation Association. (2011). Public statement on cultural competence in evaluation. Available at http://www.eval.org/ccstatement.
Bamberger, M., & Segone, M. (2011). How to design and manage equity-focused evaluations. New York, NY: UNICEF.
Bossuyt, J., Shaxson, L. & Datta, A. (2014). Assessing the uptake of strategic evaluations in EU development cooperation: Study on the uptake of learning from Europe Aid's strategic evaluations into development policy and practice. Brussels: EuropeAid.
Bowman, N., Dodge-Francis, C., & Tyndall, M. (2015). Culturally responsive indigenous evaluation: A practical approach for evaluating indigenous projects in tribal reservation contexts. In S. Hood, R. Hopson, & H. Frierson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 335-360). Greenwich, CT: Information Age Publishing. DOI: https://doi.org/10.1108/978-1-62396-937-020251021
Bryson, J., Patton, M., & Bowman, R. (2011). Working with evaluation stakeholders: A rationale, step-wise approach and toolkit. Evaluation and Program Planning, 34, 1-12. https://doi.org/10.1016/j.evalprogplan.2010.07.001 DOI: https://doi.org/10.1016/j.evalprogplan.2010.07.001
Canadian International Development Agency. (2004). CIDA evaluation guide. Ottawa.
Canadian Journal of Program Evaluation (CJPE). (2015). Special issue, 30.
Carden, F., & Alkin, M. C. (2012). Evaluation roots: An international perspective. Journal of MultiDisciplinary Evaluation, 8(17), 108-118. https://doi.org/10.56645/jmde.v8i17.348 DOI: https://doi.org/10.56645/jmde.v8i17.348
Carden, F. (2013). Evaluation, not development evaluation. American Journal of Evaluation, 34(4), 576-579. https://doi.org/10.1177/1098214013495706 DOI: https://doi.org/10.1177/1098214013495706
Cartland, J., Ruch-Ross, H. S., Mason, M., & Donohue, W. (2008). Role sharing between evaluators and stakeholders in practice. American Journal of Evaluation, 29(4), 460-477. https://doi.org/10.1177/1098214008326201 DOI: https://doi.org/10.1177/1098214008326201
Center for Evaluation Innovation (CEI), Institute for Foundation and Donor Learning (IFDL), Dorothy A. Johnson Center for Philanthropy, & Luminare Group. (2017). Equitable evaluation framing paper. Equitable Evaluation Initiative. Available at www.equitableeval.org.
Center for Global Development (CGD). (2006). When will we ever learn? Improving lives through impact evaluation. Washington, DC.
Chambers, R. (1995). Paradigm shifts and the practice of participatory development. In N. Nelson & S. Wright (Eds.), Power and participatory development: Theory and practice (pp. 30-42). London, UK: Intermediate Technology Publications. https://doi.org/10.3362/9781780445649.003 DOI: https://doi.org/10.3362/9781780445649.003
Chelimsky, E. (2013). Balancing theory and practice in the real world. American Journal of Evaluation, 34(1), 91-98. https://doi.org/10.1177/1098214012461559 DOI: https://doi.org/10.1177/1098214012461559
Chiappero-Martinetti, E., (2010). Verso nuovi concetti e nuove misure di progresso e sviluppo umano. Available at www.umanam-ente.org.
Chouinard, J. A., & Cousins, J. B. (2009). A review and synthesis of current research on cross-cultural evaluation. American Journal of Evaluation, 30(4), 457-494. https://doi.org/10.1177/1098214009349865 DOI: https://doi.org/10.1177/1098214009349865
Chouinard, J. A., & Hopson, R. (2015). A critical exploration of culture in international development evaluation. Canadian Journal of Program Evaluation, 30(3), 248-276. https://doi.org/10.3138/cjpe.30.3.02 DOI: https://doi.org/10.3138/cjpe.30.3.02
Christie, C. A. (2003). Editor's notes. New Directions for Evaluation, 97, 1-6. https://doi.org/10.1002/ev.71 DOI: https://doi.org/10.1002/ev.71
Cornwall, A., & Gaventa, J. (2001). Bridging the gap: Citizenship, participation and accountability. PLA Notes, 40, 32-35.
Coryn, C. L., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011). A systematic review of theory-driven evaluation practice from 1990 to 2009. American Journal of Evaluation, 32(2), 199-226. https://doi.org/10.1177/1098214010389321 DOI: https://doi.org/10.1177/1098214010389321
Council of the European Union (2015). Conclusions on culture in the EU's external relations with a focus on culture in development cooperation. OJ C 417, 15.12.2015.
Cousins, J., B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 80, 5-23. https://doi.org/10.1002/ev.1114 DOI: https://doi.org/10.1002/ev.1114
Cracknell, B. (2000). Evaluating development aid: Issues, problems, solutions. London, UK Sage.
Cram F., & Mertens, D. M. (2016). Negotiating solidarity between indigenous and transformative paradigms in evaluation. Evaluation Matters-He Take Tō Te Aromatawai, 2, 161-189. https://doi.org/10.18296/em.0015 DOI: https://doi.org/10.18296/em.0015
Cullen, A. E., Coryn, C. L., & Rugh, J. (2011a). The politics and consequences of including stakeholders in international development evaluation. American Journal of Evaluation, 32(3), 345-361. https://doi.org/10.1177/1098214010396076 DOI: https://doi.org/10.1177/1098214010396076
Cullen, A. E., & C. Coryn (2011b). Forms and functions of participatory evaluation in international development: A review of the empirical and theoretical literature. Journal of MultiDisciplinary Evaluation, 7(16), 32-47. https://doi.org/10.56645/jmde.v7i16.288 DOI: https://doi.org/10.56645/jmde.v7i16.288
Davies, R., & Dart, J. (2005). The 'Most Significant Change (MSC) technique': A guide to its use. Available at http://mande.co.uk/docs/MSCGuide.pdf.
D'Hollander, D., Marx, A., & Wouters, J. (2014). Integrating human rights into development cooperation: A comparative assessment of strategies and practices of donors. Paper no. 15. Leuven: Leuven Centre for Global Governance Studies.
De Toma, C. (2010). Outreach toolkit. Availabe at http://www.cso-effectiveness.org.
Dean-Coffey, J. (2018). What's race got to do with it? Equity and philanthropic evaluation practice. American Journal of Evaluation, 39(4), 527-542. https://doi.org/10.1177/1098214018778533 DOI: https://doi.org/10.1177/1098214018778533
Dijkstra, G., & A., de Kemp (2015). Challenges in evaluating budget support and how to solve them. Evaluation, 21(1), 83-98. https://doi.org/10.1177/1356389014564720 DOI: https://doi.org/10.1177/1356389014564720
Donaldson, S. I. (Ed). (2013). Emerging practices in international development evaluation. Evaluation and Society. USA: Charlotte, NC: Information Age Publishing.
Donaldson, S., & Lipsey, M. W. (2006). Roles for theory in contemporary evaluation practice: Developing practical knowledge. In I. Shaw, J. C. Greene, & M. M. Mark (Eds.), The Handbook of Evaluation: Policies, Programs, and Practices (pp. 56-75). London, UK: Sage. https://doi.org/10.4135/9781848608078.n2 DOI: https://doi.org/10.4135/9781848608078.n2
Earl, S., Carden, F., & Smutylo, T. (2001). Outcome mapping: Building learning and reflection into development programmes. Ottawa, Canada: International Development Research Centre.
Estrella, M. (2000). An introduction. In M. Estrella et al. (Eds.), Learning from Change: Issues and experiences in participatory monitoring and evaluation (pp. 1-14). London, UK: Intermediate Technology Publications. https://doi.org/10.3362/9781780441214.001 DOI: https://doi.org/10.3362/9781780441214.001
European Commission (2012). Budget support guidelines. European Commission, DEVCO A2.
European Commission (2015a). 2014 report on the implementation of the EU plan of action on gender equality and women's empowerment in development (2010-2015).
European Commission (2015b). Evaluation of EU support to gender equality and women's empowerment in partner countries. Final report volume 1: Main report.
European Commission (2015c). Gender equality and women's empowerment: Transforming the lives of girls and women through EU external relations 2016-2020. SWD (2015) 182 final.
Evalsed (2003). Guide to the evaluation of socioeconomic development, sourcebook 2. Avaliable at http://ec.europa.eu/regional_policy/sources/docgener/evaluation/evalsed.
Ferreira, F. H. G., & Ravallion, M. (2008). Global poverty and inequality: A review of the evidence. Policy Research Working Paper Series. World Bank. https://doi.org/10.1596/1813-9450-4623 DOI: https://doi.org/10.1596/1813-9450-4623
Fetterman, D. (1994). Empowerment evaluation. Evaluation Practice, 15(1), 1-15. https://doi.org/10.1177/109821409401500101 DOI: https://doi.org/10.1016/0886-1633(94)90055-8
Fetterman, D. (1996a). Reflections on emergent themes and next steps empowerment evaluation. In D. Fetterman, S. J. Kaftarian, & A. Wandersman (Eds.), Empowerment evaluation, knowledge and tools for self-assessment and accountability (pp. 379-384). Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781452243573.n16 DOI: https://doi.org/10.4135/9781452243573.n16
Fetterman, D. (1996b). Empowerment evaluation: An introduction to theory and oractice. In D. Fetterman, S. J. Kaftarian, & A. Wandersman (Eds.), Empowerment evaluation, knowledge and tools for self-assessment and accountability (pp. 3-46). Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781452243573.n1 DOI: https://doi.org/10.4135/9781452243573.n1
Fitzpatrick, J. L. (2012). An introduction to context and its role in evaluation practice. New Directions for Evaluation, 135, 7-24. https://doi.org/10.1002/ev.20024 DOI: https://doi.org/10.1002/ev.20024
Frierson, H. T., Hood, S., & Hughes, G. B. (2010). A guide to conducting culturally responsive evaluations. In J. Frechtling (Ed.), The 2010 user-friendly handbook for project evaluation (pp.74-96). Arlington, VA: National Science Foundation.
Fuentes-Nieva, R., & Galasso, N. (2014). Working for the few: Political capture and economic inequality. Briefing Paper, Oxford, Oxfam International.
Fuhr, H., Gagnon, J., & S. Reinert, E. (2018). A historical overview of development paradigms. In OECD (Eds.), Perspectives on global development 2019: Rethinking development strategies (pp.131-183). Paris: OECD Publishing.
Greene, J. (2005). Context. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 82-84). Thousand Oaks, CA: Sage.
Greene, J. (2012). Values-engaged evaluations. In M. Segone (Ed.), Evaluation for equitable development results (pp.192-206). UNICEF.
Greene, J., Millett, R., & Hopson, R. K. (2004). Evaluation as democratizing practice. In M. Braverman, N. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy (pp. 96-118). San Francisco, CA: JosseyBass.
Guijt, I. (2010). Accountability and learning. In J. Ubels, N. A. Acquaye-Baddoo, & A. Fowler (Eds.), Capacity development in practice (pp. 277-291). London, UK: EarthScan.
Hilhorst, T., & Guijt, I. (2006). Participatory monitoring and evaluation: A process to support governance and empowerment at the local level. Amsterdam: Royal Tropical Institute.
Hood, S. (2001). Nobody knows my name: In praise of African American evaluators who were wings. New Directions for Evaluation, 92, 31-44. https://doi.org/10.1002/ev.33 DOI: https://doi.org/10.1002/ev.33
Hood, S. (2004). A journey to understand the role of culture in program evaluation: Snapshots and personal reflections of one African American evaluator. New Directions for Evaluation, 102, 21-37. https://doi.org/10.1002/ev.113 DOI: https://doi.org/10.1002/ev.113
Hood, S. (2005). Culturally-responsive evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 96-100). Thousand Oaks, CA: Sage.
Hopson, R. K. (2014). Justice signposts in evaluation theory, practice, and policy. New Directions for Evaluation, 142, 83-94. https://doi.org/10.1002/ev.20087 DOI: https://doi.org/10.1002/ev.20087
Hopson, R. K., Kirkhart, K. E., & Bledsoe, K. B. (2012). Decolonizing evaluation in a developing world: Implications and cautions for Equity-focused evaluations. In M. Segone (Ed.), Evaluation for equitable development results (pp. 59-82). New York, NY: UNICEF. https://doi.org/10.1002/ev.20027 DOI: https://doi.org/10.1002/ev.20027
House, E.R. (1993). Professional Evaluation: Social impact and political consequences. Newbury Park, CA: Sage.
House, E.R. (2004). Intellectual history in evaluation. In M. Alkin (Ed.), Evaluation roots (pp.218-224). Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412984157.n14 DOI: https://doi.org/10.4135/9781412984157.n14
House, E. R., & Howe, K. R. (2000a). Deliberative democratic evaluation checklist. Available at http://wmich.edu/evalctr/checklists/dd.
House, E. R., & Howe, K. R. (2000b). Deliberative democratic evaluation. In K. E. Ryan & L. DeStefano (Eds.), Evaluation as a democratic process: Promoting inclusion, dialogue, and deliberation. New Directions for Evaluation, 85, 3-12. https://doi.org/10.1002/ev.1157 DOI: https://doi.org/10.1002/ev.1157
International Council on Human Rights Policy (ICHRP). (2012). No perfect measure: Rethinking evaluation and assessment of human rights work. Available at http://www.ichrp.org/files/reports/68/181_evaluating_hr_work_report.pdf.
Independent Evaluation Office (IEO). (2015). How to manage gender-responsive evaluation. UN Women.
International Fund for Agricultural Development (IFAD). (2015). Evaluation manual. Rome: IFAD.
Johnston-Goodstar, K. (2012). Decolonizing evaluation: The necessity of evaluation advisory groups in indigenous evaluation. New Directions for Evaluation, 136, 109-117. https://doi.org/10.1002/ev.20038 DOI: https://doi.org/10.1002/ev.20038
Joint Statement by the Council and the representatives of the Governments of the Member States meeting within the Council, the European Parliament and the Commission on European Union Development Policy (2005). The European consensus. 14820/05, 22 November 2005, Brussels.
Kabeer, N. (2010). Can the MDGs provide a pathway to social justice? The challenge of intersecting inequalities. Brighton: Institute of Development Studies.
Kirkhart, K. E. (2010). Eyes on the prize: Multicultural validity and evaluation theory. American Journal of Evaluation, 31, 400-413. https://doi.org/10.1177/1098214010373645 DOI: https://doi.org/10.1177/1098214010373645
Kirkhart, K. E. (2011). Culture and influence in multi-site evaluation. New Directions for Evaluation, 129, 73-85. https://doi.org/10.1002/ev.356 DOI: https://doi.org/10.1002/ev.356
Kirkhart, K. E. (2016). Equity, privilege, and validity: Traveling companions or strange bedfellows? In S. Donaldson & R. Picciotto (Eds.), Evaluation for an equitable society. Charlotte, NC: Information Age. DOI: https://doi.org/10.1108/978-1-68123-445-820251007
LaFrance, J., & Nichols, R. (2010). Reframing evaluation: Defining an Indigenous evaluation framework. Canadian Journal of Program Evaluation, 23, 13-31. https://doi.org/10.3138/cjpe.23.003 DOI: https://doi.org/10.3138/cjpe.23.003
Lee, K. (2004). The importance of culture in evaluation: A practical guide for evaluators. Denver, CO: The Colorado Trust.
MacDonald, B. (1974). Evaluation and the control of education. In B. MacDonald, & R. Walker (Eds.), Innovation, evaluation, research, and the problem of control (pp. 9-22). Norwich, UK: SAFARI Project, University of East Anglia.
MacDonald, B. (1978). Democracy and evaluation. Public address at the University of Alberta Faculty of Education, 17 October, 1978.
Mansuri, G., & Rao, V. (2013). Localizing development: Does participation work? Washington, DC: World Bank. https://doi.org/10.1596/978-0-8213-8256-1 DOI: https://doi.org/10.1596/978-0-8213-8256-1
Mathison, S. (2005). Preface. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. xxxiii-xxxv). Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412950558 DOI: https://doi.org/10.4135/9781412950558
McBride, D. F. (2011). Sociocultural theory: Providing more structure to culturally responsive evaluation. New Directions for Evaluation, 131, 7-13. https://doi.org/10.1002/ev.371 DOI: https://doi.org/10.1002/ev.371
Melamed, C. (2012). Putting inequality in the post-2015 picture. London, UK: ODI (Overseas Development Institute).
Mertens, D. (2007). Transformative paradigm: Mixed methods and social justice. Journal of Mixed Methods Research, 1, 212-225. https://doi.org/10.1177/1558689807302811 DOI: https://doi.org/10.1177/1558689807302811
Mertens, D. (2010). Social transformation and evaluation. Evaluation Journal of Australasia, 10(2), 3-10. https://doi.org/10.1177/1035719X1001000202 DOI: https://doi.org/10.1177/1035719X1001000202
Mertens, D. (2012). When human rights is the starting point for evaluation. In M. Segone (Ed.), Evaluation for equitable development results (pp. 25-38). New York, NY: UNICEF.
Mertens, D. (2016). Assumptions at the philosophical and programmatic levels in evaluation. Evaluation and Program Planning, 59, 102-108. https://doi.org/10.1016/j.evalprogplan.2016.05.010 DOI: https://doi.org/10.1016/j.evalprogplan.2016.05.010
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (1999). Linee guida per la lotta alla povertà.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2009). Salute Globale: Principi Guida della Cooperazione Italiana - 2014-2016.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2010a). La valutazione in itinere ed ex-post dell'APS- Linee guida.
Ministero degli Affari Esteri (2010b). Linee Guida per uguaglianza di genere e empowerment delle donne.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2010c). Linee guida per l'introduzione della tematica della disabilità nell'ambito delle politiche e delle attività della Cooperazione Italiana.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2010d). Linee guida per la cooperazione italiana sulla democratica ownership.
Ministero degli Affari Esteri (2010e). La cooperazione italiana allo sviluppo nel triennio 2010-2012, Linee-Guida e indirizzi di programmazione.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2012a). Linee Guida sui Minori.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2012b). Piano efficacia.
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo, (2012c). Good humanitarian donorship initiative. Principles and good practice of humanitarian donorship (2012-2015).
Ministero degli Affari Esteri, Direzione Generale per la Cooperazione allo Sviluppo (2014). Relazione annuale al Parlamento sull'attuazione della politica di cooperazione allo sviluppo nel 2013.
Morra, L., Imas, R., & Rist, R. (2009). The road to results: Designing and conducting effective development evaluations. World Bank. https://doi.org/10.1596/978-0-8213-7891-5 DOI: https://doi.org/10.1596/978-0-8213-7891-5
Newman, D. L., & Brown, R. D. (1996). Applied ethics for program evaluation. Thousand Oaks, CA: Sage.
OECD (2009). Italy: Development Assistance Committee peer review. Paris: OECD Publications.
OECD (2012). Evaluating budget support, methodological approach. OECD/DAC Network on Development Evaluation.
OECD/DAC (1997). Evaluation of programs promoting participatory development and good governance. Paris: OECD/DAC.
OECD/ DAC (2010). Quality standards for development evaluation. Paris: OECD. https://doi.org/10.1787/9789264083905-en DOI: https://doi.org/10.1787/9789264083905-en
Ofir, Z., & Kumar, S. (2013). Evaluation in developing countries: What makes it different? In S. I. Donaldson, T. Azzam & Conner (Eds.), Emerging practices in international evaluation (pp.11-24). Charlotte, NC: Information Age Publishing. DOI: https://doi.org/10.1108/978-1-62396-185-520251003
OHCHR (2004). Human rights and poverty reduction: conceptual framework. New York, NY: United Nations.
Ottier, A. (2005). Participatory evaluation in the context of cbpd: theory and practice in international development. Canadian Journal of Program Evaluation, 20(1), 123-148. https://doi.org/10.3138/cjpe.020.006 DOI: https://doi.org/10.3138/cjpe.020.006
Patton, M. Q. (1997). Utilization-focused evaluation: The new century text. Thousand Oaks, CA: Sage.
Pawson, R., & Tilley, N. (1997). Realistic evaluation. London, UK: Sage.
Peersman, G. (2014). Evaluative criteria. Methodological Briefs Impact Evaluation, 3. UNICEF.
Peersman, G., & Rogers, P. (2016). Addressing equity issues in monitoring and evaluation. Development Bulletin, 77, 37-42.
Picciotto, R. (2015). Bringing inequality back in from the cold: Toward a progressive evaluation model. In R. Rist, F. P. Martin, & A. M. Fernandez (Eds.), Poverty, inequality, and evaluation: Changing perspectives (pp. 253-277). Washington, DC: World Bank Group. https://doi.org/10.1596/978-1-4648-0703-9_ch13 DOI: https://doi.org/10.1596/978-1-4648-0703-9_ch13
Podems, D. (2010). Feminist evaluation and gender approaches: There's a difference? Journal of MultiDisciplinary Evaluation, 6(14), 1-17. https://doi.org/10.56645/jmde.v6i14.199 DOI: https://doi.org/10.56645/jmde.v6i14.199
Poverty Analysis Discussion Group. (2012). Understanding poverty and wellbeing: A note with implications for research and policy.
Rog, D. (2015). Infusing theory into practice, practice into theory: Small wins and big gains for evaluation. American Journal of Evaluation, 36(2), 223-238. https://doi.org/10.1177/1098214015573068 DOI: https://doi.org/10.1177/1098214015573068
Rogers, P. (2012a). Methodological challenges in using programme theory to evaluate pro-poor and equity-focused programmes. In M. Segone (Ed.), Evaluation for equitable development results (pp. 142-171). New York, NY: UNICEF.
Rogers, P. (2012b). Introduction to impact evaluation. Impact Evaluation Notes, 1. Interaction.
Rosenstein, B., & Desivilya, H. (2015). Editor's note. New Directions for Evaluation, 146, 3-7. https://doi.org/10.1002/ev.20115 DOI: https://doi.org/10.1002/ev.20115
Samuels, M., & Ryan, K. (2011). Grounding evaluations in culture. American Journal of Evaluation, 32(2), 183-198. https://doi.org/10.1177/1098214010387657 DOI: https://doi.org/10.1177/1098214010387657
Schwandt, T. (2015). Evaluation foundations revisited: Cultivating a life of the mind for practice. Stanford, CA: Stanford University Press.
Schwandt, T. (2018). Acting together in determining value: A professional ethical responsibility of evaluators. Evaluation, 24(3), 306-317. https://doi.org/10.1177/1356389018781362 DOI: https://doi.org/10.1177/1356389018781362
Segone, M. (2012a). Evaluation for equitable development results. New York, NY: UNICEF.
Segone, M. (2012b). Evaluation to accelerate progress towards equity, social justice and human rights. In Segone (Ed.), Evaluation for equitable development results (pp.8-12). New York, NY: UNICEF.
Seigart, D. (2005). Feminist evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 154-157). Thousand Oaks, CA: Sage.
Sen, A. (1999). Development as freedom. Oxford, UK: Oxford University Press.
Sen, A. (2005). Human rights and capabilities. Journal of Human Development and Capabilities, 6(2), 151-166. https://doi.org/10.1080/14649880500120491 DOI: https://doi.org/10.1080/14649880500120491
SenGupta, S., Hopson, R., & Thompson-Robinson, M. (2004). Cultural competence in evaluation: An overview. New Directions for Evaluation, 102, 5-19. https://doi.org/10.1002/ev.112 DOI: https://doi.org/10.1002/ev.112
Solheim, E. (2012). Introduction. In OECD, Evaluating development activities: 12 lessons from the OECD DAC (pp.7-8). Paris: OECD.
Stake, R. E. (1975). Program evaluation: Particularly pesponsive evaluation. Occasional paper series no. 5, Western Michigan University.
Stake, R. E. (2004a). How far dare an evaluator go toward saving the world. American Journal of Evaluation, 25(1), 103-107. https://doi.org/10.1177/109821400402500108 DOI: https://doi.org/10.1177/109821400402500108
Stake, R. E. (2004b). Standards-based and responsive evaluation. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412985932 DOI: https://doi.org/10.4135/9781412985932
Stame, N. (1998). Evaluation in Italy: experience and prospects. Evaluation, 4(1), 91-103. https://doi.org/10.1177/13563899822208419 DOI: https://doi.org/10.1177/13563899822208419
Stame, N. (2018). Strengthening the ethical expertise of evaluators. Evaluation, 24(4), 438-451. https://doi.org/10.1177/1356389018804942 DOI: https://doi.org/10.1177/1356389018804942
Start, D., & Hovland, I. (2007). Tools for policy Impact: A handbook for researchers. ODI.
Stern, E. (2006). Contextual challenges for evaluation practice. Sage Handbook of Evaluation (pp. 292-314). London, UK: Sage.
Stern, E. with contributions from Altinger, L., Feinstein O., Marañón M., Nils-Sjard Schultz, N. & Steen Nielsen N. (2008). Thematic study on the Paris Declaration, aid effectiveness and development effectiveness. Copenhagen: Ministry of Foreign Affairs of Denmark.
Thompson-Robinson, M., Hopson, R., & SenGupta, S. (2004). In search of cultural competence in evaluation: Toward principles and practices. New Directions for Evaluation, 102, 39-50. https://doi.org/10.1002/ev.111 DOI: https://doi.org/10.1002/ev.112
Trésor (2014). Lignes de crédit en faveur des PME-PMI en Tunisie et dans les territoires palestiniens. Unité d'Evaluation des Activités de Développement. Available at www.tresor.economie.gouv.fr/evaluation-des-activites-de-developpement.
United Nations Department of Economic and Social Affairs (UNDESA). (2013). Inequality matters: Report of the world social situation 2013. New York, NY: UN.
United Nations Educational, Scientific and Cultural Organisation (UNESCO). (2001). UNESCO universal declaration on cultural diversity. Available at: https://www.refworld.org/docid/435cbcd64.html.
United Nations High Level Panel Report on Post-2015 Development Agenda. (2013). A new global partnership: Eradicate poverty and transform economies through sustainable development. New York, NY: UN.
United Nations Task Team on the Post 2015 UN Development Agenda. (2012). Addressing inequalities: the heart of the 2015 agenda and the future we want for all. Thematic think piece, ECE, ESCAP, UN DESA, UNRISD, UN Women.
United Nations Women. (2014). Gender mainstreaming in development programming. New York, NY: UN Women.
United Nations Development Programme (UNDP). (2009). Handbook on planning, monitoring and evaluating for development results. New York, NY: UNDP.
United Nations Development Programme (UNDP). (2013). Humanity divided: Confronting inequality in developing countries. New York, NY: UNDP.
United Nations Development Programme (UNDP). (2014). (HDR), Sustaining progress: Reducing vulnerabilities and building resilience. New York, NY: UNDP.
UNDP, UNFPA, UNICEF, WFP (2011). Joint Meeting of the Executive Boards Equity: narrowing the gaps to push for achievement of the Millennium Development Goals.
UNDP, UNOPS (2009). Regional level. Governance and Local Development. Art Gold 2 Albania.
UNICEF, UN Women. (2013). Global thematic consultation on the post-2015 development agenda: Addressing inequalities-Synthesis report of global public consultation. UNICEF & UN Women.
United Nations (UN). (2011a). The evaluation policy of UNDP. DP/2011/3.
United Nations (UN). (2011b). Delivering as one for development, one UN programme. Albania: UN.
United Nations (UN). (2015). Transforming our world: The 2030 agenda for sustainable development. Available at A/RES/70/1. http://undocs.org/A/RES/70/1.
United Nations Evaluation Group (UNEG). (2008). Ethical guidelines for evaluation. New York, NY: UNEG.
United Nations Evaluation Group (UNEG). (2013). Impact evaluation in UN agency evaluation systems: Guidance on selection, planning and management. New York, NY: UNEG.
United Nations Evaluation Group (UNEG). (2014). Integrating human rights and gender equality in evaluations. New York, NY: UNEG.
United Nations Evaluation Group (UNEG). (2016). Norms and standards for evaluation. New York, NY: UNEG.
United Nations Research Institute for Social Development (UNRISD). (2010). Combating poverty and inequality. Geneva: UNRISD.
Valutazioni, retrieved February 26, 2015, from http//www. cooperazione/Leggi e procedure/Valutazioni.
Vogel, I. (2012). Review of the use of Theory of Change in International Development: Review report. DFID.
Weiss, C. H. (1983). The stakeholder approach to evaluation: Origins and promise. New Directions for Program Evaluation, 17, 3-14. https://doi.org/10.1002/ev.1322 DOI: https://doi.org/10.1002/ev.1322
World Health Organisation. (WHO). (2013). WHO evaluation practice handbook. Geneva: World Health Organization.
Woolcock, M. (2014). Culture, politics, and development. Policy Research, Working Paper 6939. https://doi.org/10.1596/1813-9450-6939 DOI: https://doi.org/10.1596/1813-9450-6939
World Bank. (2006). World development report, equity and development. World Bank, Oxford University Press.
World Bank. (2013). Inclusion matters: The foundation for shared prosperity. Washington, DC: World Bank. https://doi.org/10.1596/9781464800108 DOI: https://doi.org/10.1596/9781464800108