Failing Forward Quickly as a Developmental Evaluator: Lessons from Year One of the LiveWell Kershaw Journey
Main Article Content
Abstract
Background: Learning to be a developmental evaluator is challenging because it is relatively new and sparsely documented in the scholarly literature. Developmental evaluation is intended to support the ever-changing and adaptive nature of complex environments. In a developmental, systems-oriented evaluation framework, the evaluator is embedded in the process to support and generate learnings from ongoing findings.
Purpose: This article presents the lessons learned through one case study and how the concept of failing forward can guide the evaluator’s reflective process through a developmental evaluation.
Setting: Free clinic and community setting in Kershaw County, South Carolina
Intervention: NA
Research Design: NA
Data Collection and Analysis: The Evaluator documented mistakes and lessons learned during the beginning, planning and implementation stages of a complex community health initiative.
Findings: The evaluation team shares five mistakes made along during the journey and lessons learned. It’s important for teams to understand what differentiates developmental evaluation from other types of evaluation and the role of the evaluator. The “critical friend” boundary can be easily crossed and the evaluator needs to have a strong understanding of the needs of the initiative.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Cousins, J. B., Goh, S. C., Elliott, C. J., & Bourgeois, I. (2014). Framing the capacity to do and use evaluation. In J. B. Cousins & I. Bourgeois (Eds.), Organizational capacity to do and use evaluation. New Directions for Evaluation, 141, 7-23 https://doi.org/10.1002/ev.20076 DOI: https://doi.org/10.1002/ev.20076
Dozois, E., Langlois, M and Blanchet-Cohen, N. (2010). DE 201: A Practioner's Guide to Developmental Evaluation. Retrieved from http://www.mcconnellfoundation.ca/assets/Media%20Library/Publications/DE%20201%20EN.pdf
FSG. (September, 2013). Collective Impact Case Study: The Road Map Project. Retrieved August 1, 2014, from http://www.collectiveimpactforum.org/sites/default/files/CI_Case_Study_Road_Map_1.pdf
Gamble, J. (2008). A Developmental Evaluation Primer. The J.W. McConnell Family Foundation. Retrieved from http://www.mcconnellfoundation.ca/assets/Media%20Library/Publications/A%20Developmental%20Evaluation%20Primer%20-%20EN.pdf
Howard, P. (2015). Failing Forward Quickly: Lessons from the 100,000 Homes Campaign. Presentation at the Community Health Improvement Leadership Academy in June, 2015.
Langlois, M, Blanchet-Cohen, N, Beer T. (2013) The art of the nudge: five practices for developmental evaluators. Center for Evaluation Innovation. https://doi.org/10.3138/cjpe.27.003 DOI: https://doi.org/10.3138/cjpe.27.003
Maxwell, J. (2007). Failing forward: turning mistakes into stepping stones for success. Nashville: Thomas Nelson.
Parsons, B. (2012). Systems-oriented evaluation. PowerPoint presentation at Evaluation Café.
Patton, Michael Q. (2011). Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: Guilford.
Patton, Michael Q. (2013). The roots of utilization-focused evaluation. In M.C. Alkin (Ed.), Evaluation Roots: The Wider Perspective of Theorist's Views and Influences. (pp. 293-303). Washington, DC: Sage.
Preskill, H and Beer T. (2012). Evaluating Social Innovation. Retrieved from http://www.fsg.org/Portals/0/Uploads/Documents/PDF/Evaluating_Social_Innovation.pdf https://doi.org/10.22163/fteval.2012.119 DOI: https://doi.org/10.22163/fteval.2012.119
Rey, L., Tremblay, M.-C., & Brousselle, A. (2014). Managing Tensions Between Evaluation and Research: Illustrative Cases of Developmental Evaluation in the Context of Research. American Journal of Evaluation, 35(1), 45-60. http://doi.org/10.1177/1098214013503698 https://doi.org/10.1177/1098214013503698 DOI: https://doi.org/10.1177/1098214013503698
Robert Wood Johnson Foundation. (2015). County Health Rankings and Roadmaps. Retrieved from http://www.countyhealthrankings.org./app/south-carolina/2015/overview
Tervalon, M and Murray-Garcia, J. Cultural humility versus cultural competence: a critical distinction in defining physician training outcomes in multicultural education. Journal for Health Care for the Poor and Underserved. Vol 9:2- 117-125. https://doi.org/10.1353/hpu.2010.0233 DOI: https://doi.org/10.1353/hpu.2010.0233
Quality Improvement Hub. Driver Diagram. Accessed on October 16, 2015 at http://www.qihub.scot.nhs.uk/knowledge-centre/quality-improvement-tools/driver-diagram.aspx