The Promise of Participatory Evaluation in Family-Centered Rehabilitation Settings: A Qualitative Study
Main Article Content
Abstract
Background: Family-centered service philosophy (FCS) is an important contextual aspect of many pediatric rehabilitation programs. It recognizes the importance of supporting family relationships and the benefits of active family participation in all aspects of programming. Unfortunately, many professionals often overlook FCS philosophy when designing and implementing evaluations. Given the emphasis that participatory evaluation places on collaboration and the engagement of stakeholders, it appears to be theoretically compatible with FCS philosophy.
Purpose: To explore parents’ and staff members’ perceptions of participatory program evaluation, including its congruence with family-centered service (FCS) philosophy, as well as the feasibility and practicality of using participatory program evaluation within pediatric rehabilitation centers.
Setting: The study was conducted at two urban pediatric rehabilitation centers in Ontario, Canada.
Intervention: Not applicable.
Design: Qualitative exploration.
Data Collection and Analysis: The study included qualitative interviews, focus groups and a thematic analysis.
Findings: Participants described how participatory evaluation, in congruence with FCS philosophy, would increase the relevance of program evaluations for families, help support program interventions, assist in the development of clinician-parent relationships, and facilitate the empowerment of families. They also described how a lack of time, funding, and training, as well as variations in the priorities and interests of families presented challenges for using participatory evaluation within their centers.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Babbie, E. (2008). The basics of social research (4th ed.). Belmot, CA: Thomson.
Bazeley, P. (2007). Qualitative data analysis with NVivo. Thousand Oaks, CA: Sage.
Brazil, K. (1999). A framework for developing evaluation capacity in health care settings. International Journal of Health Care Quality Assurance, 12(1), vi-xi. https://doi.org/10.1108/13660759910249693 DOI: https://doi.org/10.1108/13660759910249693
Burke, B. (1998). Evaluating for a change: Reflections on participatory methodology. In E. Whitmore (Ed.), New Directions for Evaluation: Understanding and practicing participatory evaluation (pp. 43-56). San Francisco, CA: Jossey-Bass. https://doi.org/10.1002/ev.1116 DOI: https://doi.org/10.1002/ev.1116
Canadian Network for Child and Youth Rehabilitation. (2012). About CN-CYR Retrieved June 10, 2012, from http://cn-cyr.caphc.org/cn-cyr-dashboard/about-cn-cyr
Cousins, J. B., & Earl, L. M. (1995). Participatory evaluation in education: Studies of evaluation use and organizational learning. London, UK: Falmer.
Cousins, J. B., Elliott, C., Amo, C., Bourgeois, I., Chouinard, J., Goh, S., & Lahey, R. (2008). Organizational capacity to do and use evaluation: Results of a pan-Canadian survey of evaluators. Canadian Journal of Program Evaluation, 23(3), 1-35. https://doi.org/10.3138/cjpe.0023.002 DOI: https://doi.org/10.3138/cjpe.0023.002
Cousins, J. B., Goh, S., Clark, S., & Lee, L. (2004). Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge. Canadian Journal of Program Evaluation, 19(2), 99-141. https://doi.org/10.3138/cjpe.19.006 DOI: https://doi.org/10.3138/cjpe.19.006
Cullen, A., Coryn, C. L. S., & Rugh, J. (2011). The politics and consequences of including stakeholders in international development evaluation. American Journal of Evaluation, 32(3), 345-361. https://doi.org/10.1177/1098214010396076 DOI: https://doi.org/10.1177/1098214010396076
Daigneault, P. M., & Jacob, S. (2009). Toward accurate measurement of participation: Rethinking the conceptualization and operationalization of participatory evaluation. American Journal of Evaluation, 30(3), 330-348. https://doi.org/10.1177/1098214009340580 DOI: https://doi.org/10.1177/1098214009340580
Flynn, R., Glueckauf, R., Langill, G., & Schacter, G. (1984). Program evaluation in Canadian rehabilitation facilities for physically disabled persons: A national survey. Rehabilitation Psychology, 29(1), 11-20. https://doi.org/10.1037//0090-5550.29.1.11 DOI: https://doi.org/10.1037//0090-5550.29.1.11
Holden, D., & Zimmerman, M. (2009). Evaluation planning here and how. In D. Holden & M. Zimmerman (Eds.), A practical guide to program evaluation planning (pp. 7-31). Thousand Oaks: Sage. https://doi.org/10.4135/9781452226507.n2 DOI: https://doi.org/10.4135/9781452226507.n2
Humphries, B. (2003). What else counts as evidence in evidence-based social work? Social work education 22(1), 81-91. https://doi.org/10.1080/02615470309130 DOI: https://doi.org/10.1080/02615470309130
Institute for Patient- and Family-Centered Care. (2012). Advancing the practice of patient- and family-centered care in primary care and other ambulatory settings. Bethesda, MD: Institute for Patient- and Family-Centered Care.
King, J. A. (1998). Making sense of participatory evaluation practice. New Directions for Evaluation, 80, 57-67. https://doi.org/10.1002/ev.1117 DOI: https://doi.org/10.1002/ev.1117
Lewandowski, L., & Tesler, M. (2003). Family-centered care: Putting it into action. Washington, DC: Society of Pediatric Nurses.
Love, A. (1983). The organizational context and the development of internal evaluation In A. Love (Ed.), Developing Effective Internal Evaluation (pp. 5-21). San Francisco, CA: Jossey-Bass. https://doi.org/10.1002/ev.1348 DOI: https://doi.org/10.1002/ev.1348
Love, A. (1991). Internal evaluation: Building organizations from within. Newbury Park, CA: Sage. DOI: https://doi.org/10.4135/9781412984546
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage.
Moreau, K. (2012). Embracing the context of pediatric rehabilitation programs: Investigating the role of family-centred service philosophy in program evaluation. Unpublished Doctoral Dissertation. Ottawa: University of Ottawa.
Moreau, K., & Cousins, J. B. (2011). Program evaluation in family-centred pediatric rehabilitation settings: A review of evaluation studies and the potential use of participatory and collaborative evaluation approaches. Evaluation Journal of Australasia, 11(2), 3-13. https://doi.org/10.1177/1035719X1101100202 DOI: https://doi.org/10.1177/1035719X1101100202
Patton, M. Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage.
Patton, M. Q. (1997). Utilization-focused evaluation: The new century text. Thousand Oaks, CA: Sage.
Patton, M. Q. (2007). Process use as a usefulism. New Directions for Evaluation, 2007(116), 99-112. https://doi.org/10.1002/ev.246 DOI: https://doi.org/10.1002/ev.246
Rosenbaum, P., King, S., Law, M., King, G., & Evans, J. (1998). Family-centred service: A conceptual framework and research review. Physical and Occupational Therapy in Pediatrics 18(1), 1-20. https://doi.org/10.1300/J006v18n01_01 DOI: https://doi.org/10.1300/J006v18n01_01
Schnelker, D., & Rumrill, D. (2001). Program evaluation in rehabilitation. Work, 16, 171-175. https://doi.org/10.3233/WOR-2001-00184 DOI: https://doi.org/10.3233/WOR-2001-00184
Shulha, L. M., & Cousins, J. B. (1997). Evaluation use: Theory, research, and practice since 1986. American Journal of Evaluation, 18(1), 195-208. https://doi.org/10.1177/109821409701800121 DOI: https://doi.org/10.1177/109821409701800121
Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications (2nd ed.). San Francisco, CA: Jossey-Bass.
Weaver, L., & Cousins, J. B. (2004). Unpacking the participatory process. Journal of Multidisciplinary Evaluation, 1(19-40). https://doi.org/10.56645/jmde.v1i1.144 DOI: https://doi.org/10.56645/jmde.v1i1.144