Using Action Research to Build Evaluation Capacity in Public Health Organizations

Article Sidebar

PDF
Published: Dec 18, 2019
DOI: https://doi.org/10.56645/jmde.v15i33.539
Keywords:
evaluation capacity building, evaluation of public health programs, action research

Main Article Content

Isabelle Bourgeois
University of Ottawa
https://orcid.org/0000-0002-2381-3093
David Buetti
University of Ottawa
https://orcid.org/0000-0002-3892-9419

Abstract

Background: New practice standards in Ontario require the ongoing evaluation of public health programs. However, public health units have limited capacity to conduct and use evaluations.


Purpose: The purpose of this study was to assess an action research approach as a means to build evaluation capacity in public health units.


Setting: 36 Canadian public health units in Ontario.


Intervention: Action research for evaluation capacity building.


Research Design: Multiple-case study.


Data Collection and Analysis: Qualitative, semi-structured interviews were held with study participants after the design and implementation of evaluation capacity building strategies in their organizations. Analysis was conducted using the general inductive approach (Thomas, 2006).


Findings: Evaluation capacity building is well-supported by an action research approach.

Downloads

Download data is not yet available.

Article Details

How to Cite
Bourgeois, I., & Buetti, D. (2019). Using Action Research to Build Evaluation Capacity in Public Health Organizations. Journal of MultiDisciplinary Evaluation, 15(33), 81–90. https://doi.org/10.56645/jmde.v15i33.539
Issue
Vol. 15 No. 33 (2019)
Section
Research on Evaluation Articles
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright and Permissions

Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org

 

Author Biographies

Isabelle Bourgeois, University of Ottawa

Isabelle Bourgeois is Associate Professor at l’École nationale d’administration publique (ENAP), University of Quebec, and holds a Canada Research Chair in Program and Policy Evaluation. Her research work focuses on the role of program evaluation in improving government decision-making and resource allocation; she is specifically interested in organizational evaluation capacity and evaluation utilization. She is currently the Editor-in-Chief of the Canadian Journal of Program Evaluation.

David Buetti, University of Ottawa

David Buetti, MSS is currently completing his doctorate in population health at the University of Ottawa. He is supervised by Dr. Sébastien Savard from the University of Ottawa and Dr. Isabelle Bourgeois from l'École nationale d'administration publique. His research work focuses on evaluation capacity building practices and strategies in community-based organizations offering health and social services. Mr. Buetti's work is supported by the Fonds de recherche en santé du Québec.

References

Andrews, A. B., Motes, P. S., Floyd, A. G., Flerx, V. C., & Fede, A. L. D. (2005). Building evaluation capacity in community-based organizations: Reflections of an empowerment evaluation team. Journal of Community Practice, 13(4), 85-104. https://doi.org/10.1300/J125v13n04_06 DOI: https://doi.org/10.1300/J125v13n04_06

Bourgeois, I., Simmons, L., & Buetti, D. (2018). Building evaluation capacity in Ontario's public health units: promising practices and strategies. Public Health, 159(89-94). https://doi.org/10.1016/j.puhe.2018.01.031 DOI: https://doi.org/10.1016/j.puhe.2018.01.031

Bourgeois, I., Toews, E., Whynot, J., & Lamarche, M. (2013). Measuring organizational evaluation capacity in the Canadian federal government. Canadian Journal of Program Evaluation, 28(2), 1-19. https://doi.org/10.3138/cjpe.28.001 DOI: https://doi.org/10.3138/cjpe.28.001

Bourgeois, I., Simmons, L., Hotte, N., & Osseni, R. (2016). Measuring organizational evaluation capacity in Ontario public health units: An empirical investigation. Canadian Journal of Program Evaluation, 31(2), 165-183. https://doi.org/10.3138/cjpe.306 DOI: https://doi.org/10.3138/cjpe.306

Buetti, D., Bourgeois, I., & Savard, S. (in press). Modélisation des capacités organisationnelles en évaluation dans le secteur communautaire et implications pour le contexte québécois. Revue canadienne de recherche sur les OSBL et l'économie sociale.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa DOI: https://doi.org/10.1191/1478088706qp063oa

Carman, J.G., & Fredericks, K.A. (2010). Evaluation capacity and nonprofit organizations: Is the glass half-empty or half-full? American Journal of Evaluation, 31(1), 84-104. https://doi.org/10.1177/1098214009352361 DOI: https://doi.org/10.1177/1098214009352361

Carnochan, S., Samples, M., Myers, M., & Austin, M. (2014). Performance Measurement Challenges in Nonprofit Human Service Organizations. Nonprofit and Voluntary Sector Quarterly 43(6): 1014-32. https://doi.org/10.1177/0899764013508009 DOI: https://doi.org/10.1177/0899764013508009

Goh, S. C., Clark, S., & Lee, L. E. (2004). Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base. The Canadian Journal of Program Evaluation, 19(2), 99. https://doi.org/10.3138/cjpe.19.006 DOI: https://doi.org/10.3138/cjpe.19.006

Despard, M.R. (2016). Strengthening evaluation in nonprofit human service organizations: results of a capacity-building experiment. Human Service Organization Management Leadership and Governance, 40(4), 352-368. https://doi.org/10.1080/23303131.2016.1140101 DOI: https://doi.org/10.1080/23303131.2016.1140101

Greenwood, J. (1994). Action research: a few details, a caution and something new. Journal of Advanced Nursing, 20(1), 13-18. https://doi.org/10.1046/j.1365-2648.1994.20010013.x DOI: https://doi.org/10.1046/j.1365-2648.1994.20010013.x

Greenwood, D., Whyte, W., & Harkavy, I. (1993). Participatory action research as a process and as a goal. Human relations, 46(2), 175-175. https://doi.org/10.1177/001872679304600203 DOI: https://doi.org/10.1177/001872679304600203

Henry, G. T. and Mark, M.M. (2003) Beyond use: Understanding evaluation's influence on attitudes and actions, American Journal of Evaluation 24(3), 293-314. https://doi.org/10.1177/109821400302400302 DOI: https://doi.org/10.1177/109821400302400302

Janzen, R., Ochocka, J., Turner, L., Cook, T., Franklin, M., & Deichert, D. (2017). Building a community-based culture of evaluation. Evaluation and Program Planning, 65, 163-170. https://doi.org/10.1016/j.evalprogplan.2017.08.014 DOI: https://doi.org/10.1016/j.evalprogplan.2017.08.014

Ministry of Health and Long Term Care (MHLTC). (2017). Ontario Public Health Standards. Retrieved from http://www.health.gov.on.ca/en/pro/programs/publichealth/oph_standards/

Mitchell, G. E., & Berlan, D. (2016). Evaluation and evaluative rigor in the nonprofit sector. Nonprofit Management and Leadership, 27(2), 237-250. https://doi.org/10.1002/nml.21236 DOI: https://doi.org/10.1002/nml.21236

Norton, S., Milat, A., Edwards, B., & Giffin, M. (2016). Narrative review of strategies by organizations for building evaluation capacity. Evaluation and Program Planning, 58, 1-19. https://doi.org/10.1016/j.evalprogplan.2016.04.004 DOI: https://doi.org/10.1016/j.evalprogplan.2016.04.004

Preskill, H. & Boyle, S. (2008). Insights into evaluation capacity building: Motivations, strategies, outcomes and lessons learned. Canadian Journal of Program Evaluation, 23(3), 147-174. https://doi.org/10.3138/cjpe.0023.008 DOI: https://doi.org/10.3138/cjpe.0023.008

Propel Centre for Population Health. (2018). Propel Centre For Population Health Impact. Retrieved from https://uwaterloo.ca/propel/

Rey-Garcia, M., Liket, K., Alvarez-Gonzalez, L. I., & Maas, K. (2017). Back to basics: Revisiting the relevance of beneficiaries for evaluation and accountability in nonprofits. Nonprofit Management and Leadership, 27(4), 493-511. https://doi.org/10.1002/nml.21259 DOI: https://doi.org/10.1002/nml.21259

Sankaran, S., & Ranjan, M. (2010). Implementing organizational change using action research in two Asian cultures. Paper presented at the Defining the Future of Project Management, Washington, DC

Taylor-Powell, E. & Boyd, H. (2008). Evaluation capacity building in complex organizations. New Directions for Evaluation, 120, 55-69. https://doi.org/10.1002/ev.276 DOI: https://doi.org/10.1002/ev.276

Thomas, D. R. (2006). A general inductive approach for analyzing qualitative evaluation data. American journal of evaluation, 27(2), 237-246. https://doi.org/10.1177/1098214005283748 DOI: https://doi.org/10.1177/1098214005283748

Volkov, B. (2008). A bumpy journey to evaluation capacity: A case study of evaluation capacity building in a private foundation. Canadian Journal of Program Evaluation, 23(3), 175-197. https://doi.org/10.3138/cjpe.0023.009 DOI: https://doi.org/10.3138/cjpe.0023.009