Deconstructing the Imperial Episteme: Decolonizing Knowledge Production in Program Evaluation
Article Sidebar
Main Article Content
Abstract
Scholars, practitioners, and activists have all contributed to the discussion of decolonization of evaluation practice in recent years as attention has increasingly focused on the persistent harms of colonization. While these discussions have led to the development of evaluation frameworks rooted in Indigenous and locally-situated understandings, values, and methods, little attention has been paid to the colonial origins of Western-based evaluation practices that continue to pervade the field. This article seeks to contribute to the conversation about decolonization by focusing on the ways in which Western social theory, born of colonizing nations, has been influenced by the processes of colonization. Drawing on scholars and theorists from the Global South, this article highlights specific apparatuses for dismantling imperial ways of thinking and ways of knowing, and proposes a path forward for evaluators who wish to grapple with the deeply imperial epistemological roots of our field of practice.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Archibald, T. (2020). What’s the problem represented to be? Problem definition critique as a tool for evaluative thinking. American Journal of Evaluation, 41(1), 6–19. https://doi.org/10.1177/1098214018824043 DOI: https://doi.org/10.1177/1098214018824043
Bamberger, M. (2000). The evaluation of international development programs: A view from the front. American Journal of Evaluation, 21(1), 95–102. https://doi.org/10.1177/109821400002100108 DOI: https://doi.org/10.1016/S1098-2140(00)00050-3
Billman, J. A. H. (2019). Tackling the wicked problems in the field of evaluation [Unpublished doctoral dissertation]. Indiana University of Pennsylvania.
Billman, J. A. H. (2022). Framing evaluation in reality: An introduction to ontologically integrative evaluation. American Journal of Evaluation. https://doi.org/10.1177/10982140221075244 DOI: https://doi.org/10.1177/10982140221075244
Blaut, J. M. (1993). The colonizer’s model of the world: Geographical diffusionism and Eurocentric history. Guilford Press.
Bowman, N. R., Dodge-Francis, C., & Tyndall, M. (2015). Culturally responsive Indigenous evaluation: A practical approach for evaluating Indigenous projects in tribal reservation Contexts. In S. Hood, R. Hopson, & H. Frierson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 289–311). Information Age.
Carden, F. (2013). Evaluation, not development evaluation. American Journal of Evaluation, 34(4), 576–579. https://doi.org/10.1177/1098214013495706 DOI: https://doi.org/10.1177/1098214013495706
Carden, F., & Alkin, M. C. (2012). Evaluation roots: An international perspective. Journal of MultiDisciplinary Evaluation, 8(17), 102–118. DOI: https://doi.org/10.56645/jmde.v8i17.348
Carden, F. (2017). Building evaluation capacity to address problems of equity. New Directions for Evaluation, 154, 115–125. https://doi.org/10.1002/ev.20245 DOI: https://doi.org/10.1002/ev.20245
Césaire, A. (2010). Culture and colonization. Social Text, 28(2), 127–144. DOI: https://doi.org/10.1215/01642472-2009-071
Chakrabarty, D. (2000). Subaltern studies and postcolonial historiography. Nepantla: Views from South, 1(1), 9–32.
Chakrabarty, D. (2002). Habitations of modernity: Essays in the wake of subaltern studies. University of Chicago Press.
Chambers, R. (2008). Revolutions in development inquiry. Earthscan.
Chen, H. T. (1990). Issues in constructing program theory. New directions for program evaluation, 47, 7–18. DOI: https://doi.org/10.1002/ev.1551
Chilisa, B., Major, T. E., Gaotlhobogwe, M., & Mokgolodi, H. (2016). Decolonizing and Indigenizing evaluation practice in Africa: Toward African relational evaluation approaches. Canadian Journal of Program Evaluation, 30(3), 313–328. DOI: https://doi.org/10.3138/cjpe.30.3.05
Chilisa, B., & Mertens, D. M. (2021). Indigenous made in Africa evaluation frameworks: Addressing epistemic violence and contributing to social transformation. American Journal of Evaluation, 42(2), 241–253. https://doi.org/10.1177/1098214020948601 DOI: https://doi.org/10.1177/1098214020948601
Chouinard, J. A., & Hopson, R. K. (2016). A critical exploration of culture in international development evaluation. Canadian Journal of Program Evaluation, 30(3), 248–276. DOI: https://doi.org/10.3138/cjpe.30.3.02
Cram, F. (2016). Lessons on decolonizing evaluation from Kaupapa Maori evaluation. Canadian Journal of Program Evaluation, 30(3), 296–312. DOI: https://doi.org/10.3138/cjpe.30.3.04
Cram, F., Pipi, K., & Paipa, K. (2018). Kaupapa Maori evaluation in Aotearoa New Zealand. New Directions for Evaluation, 159, 63–77. DOI: https://doi.org/10.1002/ev.20331
Cram, F., Kennedy, V., Paipa, K., Pipi, K., & Wehipeihana, N. (2015). Being culturally responsive through Kaupapa Maori evaluation. In S. Hood, R. Hopson, & H. Frierson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 289–311). Information Age.
Delgado, R. (1989). Storytelling for oppositionists and others: A plea for narrative A. Michigan Law Review, 87(8), 2411–2441. DOI: https://doi.org/10.2307/1289308
Delgado, R., & Stefancic, J. (2012). Critical race theory: An introduction. New York University Press.
D'Souza, J. (2001). Contextualizing range and depth in Indian English. World Englishes, 20(2), 145–160. DOI: https://doi.org/10.1111/1467-971X.00206
Du Bois, W. E. B. (1898). The study of the Negro problems. The Annals of the American Academy of Political and Social Science, 11(1), 1–23. DOI: https://doi.org/10.1177/000271629801100101
Earl, S., Carden, F., & Smutylo, T. (2001). Outcome mapping: Building learning and reflection into development programs. International Development Research Centre.
Easterly, W. (2008). Institutions: Top down or bottom up? American Economic Review, 98(2), 95–99. DOI: https://doi.org/10.1257/aer.98.2.95
Fanon, Frantz. (1963). The wretched of the earth. Grove Press.
Fanon, Frantz. (1967). Black skin, white masks. Grove Press.
Freeman, M., & Vasconcelos, E. F. S. (2010). Critical social theory: Core tenets, inherent issues. New Directions for Evaluation, 127, 7–19. https://doi.org/10.1002/ev.335 DOI: https://doi.org/10.1002/ev.335
Frierson, H. T., Hood, S., Hughes, G. B., & Thomas, V. G. (2010). A guide to conducting culturally responsive evaluations. In J. Frechtling (Ed.), The 2010 user-friendly handbook for project evaluation (pp. 75–96). National Science Foundation. https://www.informalscience.org/sites/default/files/TheUserFriendlyGuide.pdf
Gandhi, L. (2019). Postcolonial Theory: A Critical Introduction. (2nd ed.). Columbia University Press. DOI: https://doi.org/10.4324/9781003116714
Gaotlhobogwe, M., Major, T. E., Koloi-Keaikitse, S., & Chilisa, B. (2018). Conceptualizing evaluation in African contexts. New Directions for Evaluation, 159, 47–62. DOI: https://doi.org/10.1002/ev.20332
Ginsberg, P. E. (1988). Evaluation in cross-cultural perspective. Evaluation and Program Planning, 11(2), 189–195. https://doi.org/10.1016/0149-7189(88)90011-0 DOI: https://doi.org/10.1016/0149-7189(88)90011-0
Go, J. (2008). American empire and the politics of meaning. Duke University Press. DOI: https://doi.org/10.2307/j.ctv1168cq6
Go, J. (2016). Postcolonial thought and social theory. Oxford University Press. DOI: https://doi.org/10.1093/acprof:oso/9780190625139.001.0001
Hall, J. N. (2019). The other side of inequality: Using standpoint theories to examine the privilege of the evaluation profession and individual evaluators. American Journal of Evaluation, 41(1), 20–33. https://doi.org/10.1177/1098214019828485 DOI: https://doi.org/10.1177/1098214019828485
Hall, S. (2018). The West and the rest: Discourse and power. In T. Das Gupta, C. E. James, C. Andersen, G.-E. Galabuzi, & R. C. A. Maaka (Eds.), Race and racialization, 2E: Essential readings. Canadian Scholars’ Press. (Original work published 1992)
Hanberger, A. (2022). Power in and of evaluation: A framework for analysis. Evaluation, 28(3), 265–283. https://doi.org/10.1177/13563890221102190 DOI: https://doi.org/10.1177/13563890221102190
Hay, K. (2010). Evaluation field building in South Asia: Reflections, anecdotes, and questions. American Journal of Evaluation, 31(2), 111–12. DOI: https://doi.org/10.1177/1098214010366175
Haraway, D. (1988). Situated knowledges: The science question in feminism and the privilege of partial perspective. Feminist Studies, 14(3), 575–599. DOI: https://doi.org/10.2307/3178066
Hood, S., Hopson, R. K., & Kirkhart, K. E. (2015). Culturally responsive evaluation: Theory, practice, and future implications. In K. E. Newcomer, H. P. Hatry, & J. S. Wholey (Eds.), Handbook of practical program evaluation (4th ed., pp. 281–317). Jossey-Bass. https://doi.org/10.1002/9781119171386 DOI: https://doi.org/10.1002/9781119171386.ch12
Hopson, R. K., Kirkhart, K. E., & Bledsoe, K. L. (2012). Decolonizing evaluation in a developing world: Implications and cautions for equity-focused evaluation. In M. Segone (Ed.), evaluation for equitable development results (pp. 59–82). UNICEF.
Hudib, H. A., Cousins, J. B., Oza, J., Lakshminarayana, U., & Bhat, V. D. (2015). A cross-cultural evaluation conversation in India: Benefits, challenges, and lessons learned. Canadian Journal of Program Evaluation, 30(3), Article 3. https://journalhosting.ucalgary.ca/index.php/cjpe/article/view/31087 DOI: https://doi.org/10.3138/cjpe.30.3.343
Huntington, S. (1996). Clash of civilizations. Simon & Schuster.
Johnston‐Goodstar, K. (2012). Decolonizing evaluation: The necessity of evaluation advisory groups in Indigenous evaluation. New Directions for Evaluation, 136, 109–117. https://doi.org/10.1002/ev.20038 DOI: https://doi.org/10.1002/ev.20038
Kawakami, A. J., Aton, K., Cram, F., Lai, M. K., & Porima, L. (2007). Improving the practice of evaluation through indigenous values and methods: Decolonizing evaluation practiceReturning the gaze from Hawaiÿi and Aotearoa. Hulili: Multidisciplinary Research on Hawaiian Well-Being, 4(1), 219–242. https://www.researchgate.net/publication/237604160
Kovach, M. (2009). Indigenous methodologies: Characteristics, conversations, and contexts. University of Toronto Press.
Ladson-Billings, G. (1998). Just what is critical race theory and what’s it doing in a nice field like education? International Journal of Qualitative Studies in Education, 11(1), 7–24. https://doi.org/10.1080/095183998236863 DOI: https://doi.org/10.1080/095183998236863
Marx, K. (1983). The portable Karl Marx (E. Kamenka, ed.). Viking Press. (Original works published 1853)
Mertens, D. (2007). Transformative paradigm: Mixed methods and social justice. Journal of Mixed Methods Research, 1(3), 212–225. https://doi.org/10.1177/1558689807302811 DOI: https://doi.org/10.1177/1558689807302811
Musker, J., & Clements, R. (Directors). (1992). Aladdin. [Film]. Walt Disney Pictures.
Ofir, Z. (2013). Strengthening evaluation for development. American Journal of Evaluation, 34(4), 582–586. https://doi.org/10.1177/1098214013497531 DOI: https://doi.org/10.1177/1098214013497531
Ofir, Z., & Shiva Kumar, A. K. (2013). Evaluation in developing countries: What makes it different? In Emerging practices in international development evaluation. Information Age Publishing.
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. Guilford Press.
Picciotto, R. (2012). Experimentalism and development evaluation: Will the bubble burst? Evaluation, 18(2), 213–229. https://doi.org/10.1177/1356389012440915 DOI: https://doi.org/10.1177/1356389012440915
Prah, K. K. (2018). The challenge of decolonizing education. Centre for Advanced Studies of African Society.
Raimondo, E. (2018). The power and dysfunctions of evaluation systems in international organizations. Evaluation, 24(1), 26–41. https://doi.org/10.1177/1356389017749068 DOI: https://doi.org/10.1177/1356389017749068
Raimondo, E., & Leeuw, F. L. (2020). Evaluation systems and bureaucratic capture: Locked in the system and potential avenues for change. In B. Perrin and T. Tyrell (Eds.), Changing bureaucracies: Adapting to uncertainty, and how evaluation can help (pp. 143-160). Routledge. DOI: https://doi.org/10.4324/9781003100584-12
Rodriguez-Biella, P., Mulder, S. S., & Zaveri, S. (2021). To be or not to be an evaluator for transformational change: Perspectives from the global south. In R. van den Berg, C. Magro, & M.-H. Adrien, (Eds.), Transformational evaluation for the global crises of our times (pp. 157–176). International Development Evaluation Association (IDEAS).
Sachs, W. (Ed.). (2009). The development dictionary: A guide to knowledge as power (2nd ed.). Zed Books.
Said, E. W. (1979). Orientalism. Vintage Books.
Sen, A. (2005). Human rights and capabilities. Journal of Human Development, 6(2), 151–166. https://doi.org/10.1080/14649880500120491 DOI: https://doi.org/10.1080/14649880500120491
Shadish, W. R. (1998). Evaluation theory is who we are. American Journal of Evaluation, 19(1), 1–19. https://doi.org/10.1177/109821409801900102 DOI: https://doi.org/10.1016/S1098-2140(99)80177-5
Shadish, W., Cook, T., & Leviton, L. (1991). Social program evaluation: Its history, tasks, and theory. In W. Shadish, T. Cook, & L. Leviton (Eds.), Foundations of Program Evaluation (pp. 19–67). Sage.
Sibanda, A., & Ofir, Z. (2021). Evaluation in an uncertain world: A view from the global south. In R. van den Berg, C. Magro, & M.-H. Adrien, (Eds.), Transformational evaluation for the global crises of our times (pp. 37–62). International Development Evaluation Association (IDEAS).
Simard, S. W. (2018). Mycorrhizal networks facilitate tree communication, learning, and memory. In F. Baluska, M. Gagliano, & G. Witzany (Eds.), Memory and learning in plants: Signaling and communication in plants (pp. 191–213). Springer. https://doi.org/10.1007/978-3-319-75596-0_10 DOI: https://doi.org/10.1007/978-3-319-75596-0_10
Smith, L. T. (2012). Decolonizing methodologies (2nd ed.). Zed Books.
Stickl Haugen, J., & Chouinard, J. A. (2018). Transparent, translucent, opaque: Exploring the dimensions of power in culturally responsive evaluation contexts. American Journal of Evaluation, 40(3), 376–394. DOI: https://doi.org/10.1177/1098214018796342
Tuck, E., & Yang, K. W. (2012). Decolonization is not a metaphor. Decolonization: Indigeneity, education & society, 1(1), 1–40.
Waapalaneexkweew (Bowman, N., Mohican/Lunaape), & Dodge-Francis, C. (2018). Culturally responsive indigenous evaluation and tribal governments: Understanding the relationship. New Directions for Evaluation, 159, 17–31. DOI: https://doi.org/10.1002/ev.20329