Between Funding Requirements and Community Priorities: Centro Hispano of Dane County’s Transformative Approach to Program Evaluation
Article Sidebar
Main Article Content
Abstract
Evaluation approaches that aim to support large-scale social change need to address neoliberal logic ingrained in the way evaluation has been institutionalized in the US since the early 1900s. Harmful dynamics resulting from evaluation’s institutional history include (1) a focus on accountability and effectiveness, (2) the perpetuation of deficit-based narratives about communities of color, and (3) a top-down approach to program development, in which funders define program goals and assessment criteria and outside academics are hired to provide research services. In consequence, evaluation contributes to the extraction and devaluation of community expertise rather than fostering learning, collaboration, critical reflection, and healing.
This article highlights ways of addressing these harmful dynamics through a case study that exemplifies an innovative evaluation approach focused on community strengths and values, healing ethno-racial trauma, and critical consciousness building. We call for funders to rethink their requirements for evaluation and emphasize the need to support evaluation infrastructure, time for critical reflection, and the development of community- and asset-based, culturally responsive evaluation approaches and tools.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Abramovitz, M., & Zelnick, J. (2015). Privatization in the human services: Implications for direct practice. Clinical Social Work Journal, 43, 283–293. https://doi.org/10.1007/s10615-015-0546-1 DOI: https://doi.org/10.1007/s10615-015-0546-1
Adames, H. Y., & Chavez-Dueñas, N. Y. (2017). Cultural foundations and interventions in Latino/a mental health: History, theory, and within group differences. Routledge. DOI: https://doi.org/10.4324/9781315724058
Bakken, L. (2020.) Evaluation Plan 2020. Centro Hispano's Programs and Services. Created by Centro Hispano of Dane County, and staff and faculty of the course CSCS 813 Transformative Evaluation in Practice, Spring 2020, University of Wisconsin–Madison.
Baldridge, B. J. (2014). Relocating the deficit: Reimagining Black youth in neoliberal times. American Educational Research Journal, 51(3), 440–472. https://doi.org/10.3102/0002831214532514 DOI: https://doi.org/10.3102/0002831214532514
Bozeman, B., Gaughan, M., Youtie, J., Slade, C. P., & Rimes, H. (2016). Research collaboration experiences, good and bad: Dispatches from the front lines. Science and Public Policy, 43(2), 226–244. https://academic.oup.com/spp/article-abstract/43/2/226/2414132 DOI: https://doi.org/10.1093/scipol/scv035
Carter, P. L. (2003). “Black” cultural capital, status positioning, and schooling conflicts for low-income African American youth. Social Problems, 50(1), 136–155. https://doi.org/10.1525/sp.2003.50.1.136 DOI: https://doi.org/10.1525/sp.2003.50.1.136
Cajete, G. (2000). Native science: Natural laws of interdependence. Clear Light Publishers.
Centro Hispano of Dane County. (2020). About Centro. Our Story. https://www.micentro.org/our-story.html
Chavez-Dueñas, N. Y., Adames, H. Y., Perez-Chavez, J. G., & Salas, S. P. (2019). Healing ethno-racial trauma in Latinx immigrant communities: Cultivating hope, resistance, and action. American Psychologist, 74(1), 49–62. https://doi.org/10.1037/amp0000289 DOI: https://doi.org/10.1037/amp0000289
Chilisa, B., Major, T. E., Gaotlhobogwe, M., & Mokgolodi, H. (2016). Decolonizing and indigenizing evaluation practice in Africa: Toward African relational evaluation approaches. Canadian Journal of Program Evaluation, 30(3), 313–328. https://doi.org/10.3138/cjpe.30.3.05 DOI: https://doi.org/10.3138/cjpe.30.3.05
Cram, F., Tibbetts, K. A., & LaFrance, J. (2018). Editors’ notes: A stepping stone in indigenous evaluation. New Directions for Evaluation, 159, 7–16. https://doi.org/10.1002/ev.20327 DOI: https://doi.org/10.1002/ev.20327
Cruz, Evelyn. (2020, February 11). The evolution of Centro Hispano of Dane County [Presentation]. Civil Society and Community Studies 813 class. School of Human Ecology, Madison, WI, United States.
Cruz, Evelyn. (2022, March 22). Evaluation community of practice meeting [Meeting minutes]. Online.
Dean-Coffey, J. (2018). What’s race got to do with it? Equity and philanthropic evaluation practice. American Journal of Evaluation, 39(4), 527–542. https://doi.org/10.1177/1098214018778533 DOI: https://doi.org/10.1177/1098214018778533
Devia, C., Baker, E. A., Sanchez-Youngman, S., Barnidge, E., Golub, M., Motton, F., Muhammad, M., Ruddock, C., Vicuña, B., & Wallerstein, N. (2017). Advancing system and policy changes for social and racial justice: Comparing a rural and urban community-based participatory research partnership in the U.S. International Journal for Equity in Health, 16(1), 1–14. https://doi.org/10.1186/s12939-016-0509-3 DOI: https://doi.org/10.1186/s12939-016-0509-3
Equitable Evaluation Initiative (EEI). (2017, July). Equitable Evaluation FrameworkTM framing paper. https://static1.squarespace.com/static/5a73584b8fd4d2dbcaa08405/t/5e4ee9411a3bc375d9a1e009/1582229829119/Equitable+Evaluation+Framing+Paper.pdf
Fetterman, D. M. (1994). Empowerment evaluation. Evaluation Practice, 15(1), 1–15. https://www.sciencedirect.com/science/article/pii/0886163394900558 DOI: https://doi.org/10.1016/0886-1633(94)90055-8
Fetterman, D., & Wandersman, A. (2007). Empowerment evaluation: yesterday, today, and tomorrow. American Journal of Evaluation, 28(2), 179–198. DOI: https://doi.org/10.1177/1098214007301350
Freire, P. (1968). Pedagogy of the Oppressed. New York, NY: Seabury Press.
Gil, R. M., Marcelin, J. R., Zuniga-Blanco, B., Marquez, C., Mathew, T., & Piggott, D. A. (2020). COVID-19 pandemic: Disparate health impact on the Hispanic/Latinx population in the United States. Journal of Infectious Diseases, 222(10), 1592–1595. https://doi.org/10.1093/infdis/jiaa474 DOI: https://doi.org/10.1093/infdis/jiaa474
Ginwright, S. A. (2010). Black youth rising: Activism and radical healing in urban America. Teachers College Press.
Ginwright, S., & Cammarota, J. (2002). New terrain in youth development: The promise of a social justice approach. Social Justice, 29(4), 82–95.
Hall, M. (2020). Blest be the tie that binds. New Directions for Evaluation, 166, 13–22. https://onlinelibrary.wiley.com/doi/10.1002/ev.20414 DOI: https://doi.org/10.1002/ev.20414
Hardin, C. (2014). Finding the ‘neo’ in neoliberalism. Cultural Studies, 28(2), 199–221. https://doi.org/10.1080/09502386.2012.748815 DOI: https://doi.org/10.1080/09502386.2012.748815
Harvey, D. (2007). Neoliberalism as creative destruction. Annals of the American Academy of Political and Social Science, 610(1), 22–44. https://doi.org/10.1177/0002716206296780 DOI: https://doi.org/10.1177/0002716206296780
Hogan, R. L. (2007). The historical development of program evaluation: Exploring past and present. Online Journal of Workforce Education and Development, II(4), 1–14. https://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=1056&context=ojwed
Hood, S., Hopson, R. K., & Kirkhart, K. E. (2015). Culturally Responsive Evaluation. In K. E. Newcomer, H. P. Hatry, & J. S. Wholey (Eds.), Handbook of practical program evaluation (4th ed., pp. 281–318). John Wiley & Sons. https://nasaa-arts.org/wp-content/uploads/2017/11/CRE-Reading-1-Culturally-Responsive-Evaluation.pdf DOI: https://doi.org/10.1002/9781119171386.ch12
Kantor, H., & Lowe, R. (1995). Class, race, and the emergence of federal education policy: From the New Deal to the Great Society. Educational Researcher, 24(3), 4–11. https://www.jstor.org/stable/1176019?seq=1 DOI: https://doi.org/10.2307/1176019
Kovach, M. (2010). Indigenous methodologies: Characteristics, conversations, and contexts. University of Toronto Press.
Kwon, S. A. (2013). Uncivil youth: Race, activism and affirmative governmentality. Duke University Press. DOI: https://doi.org/10.2307/j.ctv123x7sz
LaFrance, J., & Nichols, R. (2010). Reframing evaluation: Defining an Indigenous framework. The Canadian Journal of Program Evaluation, 23(2), 13–31. DOI: https://doi.org/10.3138/cjpe.23.003
Madaus, G. F., Stufflebeam, D. L., & Scriven, M. (1983). Program evaluation: A historical overview. In G. F. Madaus & D. L. Stufflebeam (Eds.), Evaluation models: Evaluation in education and human services (pp. 3–18). Springer. https://link.springer.com/chapter/10.1007%2F978-94-009-6669-7_1 DOI: https://doi.org/10.1007/978-94-009-6675-8_1
Martín-Baró, I. (1996). Toward a liberation psychology. In A. Aron & S. Corne (Eds.), Writings for a liberation psychology. Harvard University Press.
Mertens, D. M. (2017). Transformative research: Personal and societal. International Journal for Transformative Research, 4(1), 18–24. https://doi.org/https://doi.org/10.1515/ijtr-2017-0001 DOI: https://doi.org/10.1515/ijtr-2017-0001
Mertens, D. M. (2016). Assumptions at the philosophical and programmatic levels in evaluation. Evaluation and Program Planning, 59, 102–108. https://doi.org/10.1016/j.evalprogplan.2016.05.010 DOI: https://doi.org/10.1016/j.evalprogplan.2016.05.010
Mertens, D. M. (2015). Philosophical assumptions and program evaluation. SpazioFilosofico, 1(13), 75–86.
Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice: A comprehensive guide. The Guilford Press.
Munshi, S., & Willse, C. (2007). Foreword. In INCITE! (Ed.), The revolution will not be funded (pp. xiiv–xxii). Duke University Press.
Neubauer, L., & Hall, M. (2020). Is inciting social change something evaluators can do? Should do. New Directions for Evaluation, 166, 129–135. https://onlinelibrary.wiley.com/doi/10.1002/ev.20408 DOI: https://doi.org/10.1002/ev.20408
Patton, M. Q. (2010). Developmental evaluation: Applying complexity concepts to enhance innovation and use. Guilford Press.
Peck, J. (2013). Explaining (with) neoliberalism. Territory, Politics, Governance, 1(2), 132–157. https://doi.org/10.1080/21622671.2013.785365 DOI: https://doi.org/10.1080/21622671.2013.785365
Peck, J., & Tickell, A. (2002). Neoliberalizing space. Antipode, 34(3), 380–404. https://onlinelibrary.wiley.com/doi/abs/10.1111/1467-8330.00247 DOI: https://doi.org/10.1111/1467-8330.00247
Robinson, N. (2021a). Evaluation warriorship: Raising shields to redress the influence of capitalism on program evaluation. Genealogy, 5(1), 15. https://doi.org/10.3390/genealogy5010015 DOI: https://doi.org/10.3390/genealogy5010015
Robinson, N. (2021b). A radical arc in systematically documenting political context in advocacy evaluation. New Directions for Evaluation, 2021(171), 95–117. https://doi.org/10.1002/ev.20470 DOI: https://doi.org/10.1002/ev.20470
Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). An overview of program evaluation. In P. H. Rossi, M. W. Lipsey, & H. E. Freeman (Eds.), Evaluation: A systematic approach (7th ed., pp. 1–28). Sage Publications.
Schor, I., & Freire, P. (1987). What are the fears and risks of Transformation? In I. Schor & P. Freire (Eds.), A pedagogy for liberation: Dialogues on transforming education (pp. 53–74). Bergin & Garvey Publishers. DOI: https://doi.org/10.1007/978-1-349-18574-0_3
Sielbeck-Bowen, K., Brisolara, S., Seigart, D., Tischler, C., & Whitmore, E. (2002). Exploring feminist evaluation: The ground from which we rise. New Directions for Evaluation, 96, 3–8. https://onlinelibrary.wiley.com/doi/10.1002/ev.62 DOI: https://doi.org/10.1002/ev.62
Smith, A. (2007). Introduction. In INCITE! (Ed.), The revolution will not be funded: Beyond the non-profit industrial complex (pp. 1–18). Duke University Press. DOI: https://doi.org/10.1215/9780822373001-001
Smith, L. T. (2012). Decolonizing methodologies: Research and Indigenous peoples (2nd ed.). Zed Books.
Smith, S. R. (2010). The political economy of contracting and competition. Human Services as Complex Organizations, 2, 139–160.
Symonette, H. (2005). Culturally responsive evaluation as a resource for helpful-help. In S. Hood, R. Hopson, & H. Frierson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice. Information Age Publishing.
Symonette, H. (2013). Cultivating Self as Responsive Instrument: Working the Boundaries and Borderlands for Ethical Border Crossings. In D. M. Mertens & P. E. Ginsberg (Eds.), The Handbook of Social Research Ethics (pp. 279–294). SAGE Publications. https://doi.org/10.4135/9781483348971.n18 DOI: https://doi.org/10.4135/9781483348971.n18
Symonette, H., Miller, R. L., & Barela, E. (2020). Power, privilege, and competence: Using the 2018 AEA Evaluator Competencies to shape socially just evaluation practice. New Directions for Evaluation, 168, 117–132. https://onlinelibrary.wiley.com/doi/10.1002/ev.20433 DOI: https://doi.org/10.1002/ev.20433
Taylor, F. W. (1911). The principles of scientific management. Harper & Bros.
Waapalaneexkweew (Bowman), N., & Dodge-Francis, C. (2018). Culturally responsive Indigenous evaluation and tribal Governments: Understanding the relationship. New Directions for Evaluation, 159, 17–31. https://doi.org/10.1002/ev.20329 DOI: https://doi.org/10.1002/ev.20329
Wisconsin Partnership Program (WPP). (n.d.). The Wisconsin Population Health Service Fellowship Program. http://wiphfellowship.org/
Wisconsin Partnership Program (WPP), School of Medicine and Public Health, University of Wisconsin–Madison. (2019). Wisconsin Partnership Program announces award to health equity initiatives. News and Events. https://www.med.wisc.edu/news-and-events/2019/october/community-impact-grants/