The Pursuit of Social, Economic, and Environmental Justice through Evaluation: Learning from Indigenous Scholars and the Fifth Branch of the Evaluation Theory Tree
Article Sidebar
Main Article Content
Abstract
The world faces a climate crisis that calls for increased attention to social, economic, and environmental justice. Non-Indigenous evaluators can choose to continue their work business-as-usual, or they can choose to learn from Indigenous evaluators. The exclusion of Indigenous scholars from the evaluation theory tree results in an opportunity lost to improve theory and practice across all communities. A fifth branch on the evaluation theory tree, Context and Needs, aligns with the Indigenous paradigm and serves to stimulate questions about evaluation theory and practice that inherently address issues of justice and the importance of recognizing the interconnectedness of all living and nonliving things.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Alkin, M. (Ed.). (2004). Evaluation roots. Sage. DOI: https://doi.org/10.4135/9781412984157
Alkin, M. (Ed.). (2013). Evaluation roots (2nd ed.). Sage.
Alkin, M., & Christie, C. (Eds.). (2023). Evaluation roots (3rd ed.). Sage.
Battiste, M. (2000). Reclaiming Indigenous voice and vision. University of British Columbia Press.
Cardin, F., & Alkin, M. C. (2012). Evaluation roots: An international perspective. Journal of MultiDisciplinary Evaluation, 8(17), 102–118. DOI: https://doi.org/10.56645/jmde.v8i17.348
Cavino, H. M. (2013). Across the colonial divide: Conversations about evaluation in indigenous contexts. American Journal of Evaluation, 34(3), 339–355. DOI: https://doi.org/10.1177/1098214013489338
Chilisa, B. (2020). Indigenous research methodologies (2nd ed.). Sage.
Chilisa, B., & Mertens, D. M. (2021). Indigenous Made in Africa evaluation frameworks: Addressing epistemic violence and contributing to social transformation. American Journal of Evaluation, 42(2), 241–253. DOI: https://doi.org/10.1177/1098214020948601
Chilisa, B. (2012). Indigenous research methodologies. Sage.
Chilisa, B., & Tsheko, G. N. (2014). Mixed methods in indigenous research: Building relationships for sustainable intervention outcomes. Journal of Mixed Methods Research, 8(3), 222–233. DOI: https://doi.org/10.1177/1558689814527878
Chouinard, J. A., & Cram, F. (2019). Culturally responsive approaches to evaluation. Sage.
Christie, C. A., & Alkin M. (2004). An evaluation theory tree. In M. Alkin (Ed.), Evaluation roots (pp. 12–66). Sage.
Christie, C. A., & Alkin M. (2013). An evaluation theory tree. In M. Alkin (Ed.), Evaluation roots (2nd ed., pp. 11–58). Sage.
Cram, F., Chilisa, B., & Mertens, D. M. (2013). The journey begins. In D. M. Mertens, F. Cram, & B. Chilisa (Eds.), Indigenous pathways into social research (pp. 11–40). Left Coast Press.
Cram, F., & Chouinard, J. A. (2023). Culturally responsive evaluation: An Indigenous journey through culturally responsive approaches. In M. Alkin & C. Christie (Eds.), Evaluation roots (3rd ed., pp. 145-157). Guilford Press.
Cram, F., & Mertens, D. M. (2015), Transformative and indigenous frameworks for multimethod and mixed methods research. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford handbook of multimethod and mixed methods research inquiry (pp. 91–109). Oxford Press. DOI: https://doi.org/10.1093/oxfordhb/9780199933624.013.7
Cram, F., Tibbitts, K. A., & LaFrance, J. (2018). A stepping stone in Indigenous evaluation. New Directions in Evaluation, 159, 7–16. DOI: https://doi.org/10.1002/ev.20327
Edwards, R., Barnes, H. M., McGregor, D., & Brannelly, T. (2020). Supporting Indigenous and non-Indigenous research partnerships. The Qualitative Report, 25(13), 6–15. https://doi.org/10.46743/2160-3715/2020.4754 DOI: https://doi.org/10.46743/2160-3715/2020.4754
Gallagher, L., & Ofir, Z. (2021). The rights of nature: An emerging transformation opportunity for evaluation. Canadian Journal of Program Evaluation, 36(2), 141–161. DOI: https://doi.org/10.3138/cjpe.71575
Gaotlhobogwe, M., Major, T. E., Koloi-Keaikitse, S., & Chilisa, B. (2018). Conceptualizing evaluation in African contexts. New Directions for Evaluation, 159, 47–62. DOI: https://doi.org/10.1002/ev.20332
Guba, E., & Lincoln, Y. S. (1989). Fourth generation evaluation. Sage.
Guba, E., & Lincoln, Y. S. (2005). Paradigmatic controversies, contradictions, and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (3rd ed., pp. 191–216). Sage.
Harrits, G. S. (2011). More than method?: A discussion of paradigm differences within mixed methods research. Journal of Mixed Methods Research, 5(2), 150–166. DOI: https://doi.org/10.1177/1558689811402506
Held, M. B. (2019). Decolonizing research paradigms in the context of settler colonialism: An unsettling, mutual, and collaborative effort. International Journal of Qualitative Methods, 18, 1–16. https://doi.org/10.1177/1609406918821574 DOI: https://doi.org/10.1177/1609406918821574
Hernandez, J. (2022). Fresh banana leaves. North Atlantic Books.
Hopson, R., & Shanker, V. (2023). Culturally responsive evaluation: Critical and liberatory roots. In M. Alkin & C. Christie (Eds.), Evaluation roots (3rd ed, pp. 125-134). Guilford Press.
Intergovernmental Panel on Climate Change. (2022). Climate change 2022: Impacts, Adaptation and Vulnerability. United Nations Environment Program. https://www.unep.org/resources/report/climate-change-2022-impacts-adaptation-and-vulnerability-working-group-ii DOI: https://doi.org/10.1017/9781009325844
Kennedy, V., Cram, F., Paipa, K., Pipi, K., Baker, M., Porima, L., Sauni, P., & Tuagalu, C. (2015). Beginning a conversation about spirituality in Māori and Pasifika evaluation. In S. Hood, R. Hopson, & H. Freirson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 151–178). Information Age Publishing.
Kimmerer, R. W. (2013). Braiding sweetgrass. Milkweed.
King, Jr., M. L. (1963). Letter from the Birmingham Jail. https://letterfromjail.com/
Kolawole, D. (2022). Is local knowledge peripheral? The future of Indigenous knowledge in research and development. AlterNative, 18(1), 132–140. DOI: https://doi.org/10.1177/11771801221088667
Kovach, M. (2010). Conversational method in Indigenous research. First Peoples Child and Family Review, 5, 40–48. http://journals.sfu.ca/fpcfr/index.php/FPCFR/article/view/172/141 DOI: https://doi.org/10.7202/1069060ar
LaFrance, J., & Nichols, R., 2010. Reframing evaluation: Defining an indigenous evaluation framework. Canadian Journal of Program Evaluation, 23, 13–31. DOI: https://doi.org/10.3138/cjpe.23.003
Loud, M. L. (2021). Conclusion: Transforming evaluation practice for “business unusual”. Canadian Journal of Program Evaluation, 36(2), 187–190. DOI: https://doi.org/10.3138/cjpe.72730
Louis, R. P. (2007). Can you hear us now? Voices from the margin: Using indigenous methodologies. Geographic Research, 45(2), 130–139. DOI: https://doi.org/10.1111/j.1745-5871.2007.00443.x
Lucero, J., Wallerstein, N., Duran, B., Alegria, M., Greene-Moton, E., Israel, B., Kastelic, S., Magarati, M., Oetzel, J., Pearson, C., Schulz, A., Villegas, M., & White Hat, E. R. (2018). Development of a mixed methods investigation of process and outcomes of community-based participatory research. Journal of Mixed Methods Research, 12(1), 55–74. DOI: https://doi.org/10.1177/1558689816633309
Mertens, D. M. (1998). Research and evaluation in education and psychology. Sage.
Mertens, D. M. (2018). Mixed methods design in evaluation. Sage. DOI: https://doi.org/10.4135/9781506330631
Mertens, D. M. (2020). Research and evaluation in education and psychology (5th ed.). Sage.
Mertens, D. M. (2022a). Designing qualitative and mixed methods evaluations for transformative impact. In U. Flick (Ed.), The Sage handbook of qualitative research design (pp. 1196–1214). Sage. DOI: https://doi.org/10.4135/9781529770278.n73
Mertens, D. M. (2022b). Designing mixed methods studies to contribute to social, economic, and environmental justice: Implications for library and information sciences. In P. Ngulube (Ed.), Handbook of research on mixed methods research in information science (pp. 173–189). IGI Global. https://doi.org/10.4018/978-1-7998-8844-4.ch009 DOI: https://doi.org/10.4018/978-1-7998-8844-4.ch009
Mertens, D. M. (2023). Transformative lens in evaluation: A pathway to transformative change. In M. Alkin & C. Christie (Eds.), Evaluation roots (3rd ed., pp. 135-144). Guilford Press.
Mertens, D. M., & Cram F. (2016). Integration tensions and possibilities: Indigenous research and social transformation. International Review of Qualitative Research, 9(2), 185–191. DOI: https://doi.org/10.1525/irqr.2016.9.2.185
Mertens, D. M., & Wilson, A. T. (2019). Program evaluation theory and practice (2nd ed.). Guilford Press.
Moreton-Robinson, A. (2016). Race and cultural entrapment: Critical Indigenous studies in the twenty-first century. In A. Moreton-Robinson (Ed.), Critical Indigenous studies: Engagements in first world locations. University of Arizona Press. DOI: https://doi.org/10.1353/book.87239
Picciotto, R. (2020). The complexity of indigenous evaluation. Evaluation Matters—He Take Tō Te Aromatawai, 6, 40–54. DOI: https://doi.org/10.18296/em.0056
Ramose, M. B. (2020). Motho ke motho ka batho: An African perspective on popular sovereignty and democracy. In L. K. Jenco, M. Idris, & M. C. Thomas (Eds.), The Oxford handbook of comparative political theory. Oxford Press. DOI: https://doi.org/10.1093/oxfordhb/9780190253752.013.43
Rogers, P. J., & Davidson, E. J. (2013). Australian and New Zealand evaluation theorists. In M. Alkin (Ed.), Evaluation roots (2nd ed, p. 371–385). Sage.
Schwandt, T. A. (2019). Post-normal evaluation? Evaluation, 25(3), 317–329. https://doi.org/10.1177/1356389019855501 DOI: https://doi.org/10.1177/1356389019855501
Smith, L. T. (2012). Decolonising methodologies: Research and Indigenous people (2nd ed.). Zed Books.
Tarahita, D., & Rakhmat, M. Z. (2018, April 28). Indonesia’s Citarum: The world’s most polluted river. The Diplomat. https://thediplomat.com/2018/04/indonesias-citarum-the-worlds-most-polluted-river/
Tuck, E., & Yang, K. W. (2012). Decolonization is not a metaphor. Decolonization: Indigeneity, Education & Society, 1, 1–40. https://www.researchgate.net/publication/277992187_Decolonization_Is_Not_a_Metaphor
United Nations. (2015, September 25). Resolution adopted by the general assembly: Transforming our world: The 2030 agenda for sustainable development.
United Nations. (2007). United Nations declaration on the rights of Indigenous peoples.
UN Permanent Forum on Indigenous Peoples. (2008). Indigenous peoples and the indicators of well-being and development: Preliminary report.
Waapalaneexkweew (Bowman, N., Mohican/Lunaape), & Dodge-Francis, C. (2018). Culturally responsive indigenous evaluation and tribal governments: Understanding the relationship. New Directions for Evaluation, 159, 17–31. DOI: https://doi.org/10.1002/ev.20329
Weber-Pillwax, C. (1999). Indigenous research methodology: Exploratory discussion of an elusive subject. Journal of Education Thought, 33(1), 312–323.
Widianingsih I., & Mertens D. M. (2019). Transformative research and the sustainable development goals: Challenges and a vision from Bandung West Java. International Journal of Transformative Research, 6(1) 27–35. DOI: https://doi.org/10.1515/ijtr-2019-0005
Wilson, S. (2008). Research is ceremony: Indigenous research methods. Fernwood.
Wohlleben, P. (2016). The Hidden life of trees. Greystone Books.