Evaluation Development and Use in Social Work Practice
Main Article Content
Abstract
Background: Social workers entering the profession typically receive little, if any, content or training on evaluation practice. This is, in part, due to limited course offerings outside of the typical courses in most schools of social work. In addition, practicing social workers who often serve in the role as field instructors have not fully embraced the use of research in practice, and tend to employ less rigorous evaluative methods.
Purpose: The purpose of this study was to explore the development and use of evaluation knowledge among social work practitioners who supervise social work students.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: A mixed method, sequential research design within the context of an exploratory study was used to determine factors that facilitate evaluation, identify and prioritize evaluation competencies, and determine the extent to which evaluation constructs contribute to self efficacy, evaluation competency, evaluation influence, and leadership behaviors.
Data Collection and Analysis: A web-based survey was used followed by a participatory method that included the use of a web-based software to identify and prioritize activities that contribute to the development of evaluation knowledge and skill.
Findings: Results suggest social work education has a critical role in promoting evaluation practice, establishing evaluation practice competencies, and using evaluation results to inform policy and practice.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Adam, N., Zosky, D. L., & Unrau, Y. A. (2004). Improving the research climate in social work curricula: Clarifying learning expectations across BSW and MSW research courses. Journal of Teaching in Social Work, 24 (3/4), 1-18. https://doi.org/10.1300/J067v24n03_01 DOI: https://doi.org/10.1300/J067v24n03_01
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
Christie, C. A. (2007). Reported influence of evaluation data on decision makers' actions: An empirical examination. American Journal of Evaluation, 28(1), 8-25. https://doi.org/10.1177/1098214006298065 DOI: https://doi.org/10.1177/1098214006298065
Chun, J. & Springer, D. W. (2005). Stress and coping strategies in runaway youths: An application of concept mapping. Brief Treatment and Crisis Intervention, 5(1), 57-74. https://doi.org/10.1093/brief-treatment/mhi008 DOI: https://doi.org/10.1093/brief-treatment/mhi008
Concept Systems Incorporated. (2009). Retrieved May 19, 2009 from http://www.conceptsystemsglobal.com/
Council on Social Work Education (2001). Educational policy and accreditation standards. Alexandria, VA: Author.
Council on Social Work Education (2008). Educational policy and accreditation standards. Retrieved May 5, 2008, from http://www.cswe.org/NR/rdonlyres/2A81732E-1776-4175-AC42-65974E96BE66/0/2008EducationalPolicyandAccreditationStandards.pdf
Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks: Sage.
Deal, K. H., & Clements, J. A. (2006). Supervising students developmentally: Evaluating a seminar for new field instructors. Journal of Social Work Education, 42(2), 291-306. https://doi.org/10.5175/JSWE.2006.200400492 DOI: https://doi.org/10.5175/JSWE.2006.200400492
Elpers, K., & Westhuis, D. J. (2008). Organizational leadership and its impact on social workers' job satisfaction: A national study. Administration in Social Work, 32(3), 26-43. https://doi.org/10.1080/03643100801922399 DOI: https://doi.org/10.1080/03643100801922399
Ericson, C. B., & Tompkins, C. J. (2006). Infusing aging content into a research course: A national organization and university partnership. Educational Gerontology, 32, 225-240. https://doi.org/10.1080/03601270500476888 DOI: https://doi.org/10.1080/03601270500476888
Fortune, A. E., Lee, M., & Cavazos, A. (2005). Achievement motivation and outcome in social work field education. Journal of Social Work Education, 41(1), 115-129. https://doi.org/10.5175/JSWE.2005.200300318 DOI: https://doi.org/10.5175/JSWE.2005.200300318
Garretsen, H., Bongers, I., & Rodenburg, G. (2005). Evidence based work in the Dutch welfare sector. British Journal of Social Work, 35, 655-665. https://doi.org/10.1093/bjsw/bch206 DOI: https://doi.org/10.1093/bjsw/bch206
Greene, J. C. (1988). Communication of results and utilization in participatory program evaluation. Evaluation and Program Planning, 11, 341-351. https://doi.org/10.1016/0149-7189(88)90047-X DOI: https://doi.org/10.1016/0149-7189(88)90047-X
Gross, R., Tabenkin, H., Heymann, A., Greenstein, M., Matzliach, R., Porath, A. et al. (2007). Physicians' ability to influence the life-style behaviors of diabetic patients: implications for social work. Social Work in Health Care, 44(3), 191-204. https://doi.org/10.1300/J010v44n03_05 DOI: https://doi.org/10.1300/J010v44n03_05
Guilamo-Ramos,V., Jaccard, J., Dittus, P., Gonzalez, B., & Bouris, A. (2008). A conceptual framework for the analysis of risk and problem behaviors: The case of adolescent sexual behavior. Social Work Research, 32(1), 29-45. https://doi.org/10.1093/swr/32.1.29 DOI: https://doi.org/10.1093/swr/32.1.29
Haag Granello, D., & Wheaton, J. E. (2004). Online data collection: Strategies for research. Journal of Counseling & Development, 82, 387- 393. https://doi.org/10.1002/j.1556-6678.2004.tb00325.x DOI: https://doi.org/10.1002/j.1556-6678.2004.tb00325.x
Hamama, L., Ronen, T., & Rahav, G. (2008). Self-control, self-efficacy, role overload, and stress responses among siblings of children with cancer. Health & Social Work, 33(2), 121-132. https://doi.org/10.1093/hsw/33.2.121 DOI: https://doi.org/10.1093/hsw/33.2.121
Henry, G. T. (2003). Influential evaluations. American Journal of Evaluation, 24(4), 515-524. https://doi.org/10.1177/109821400302400409 DOI: https://doi.org/10.1016/j.ameval.2003.10.001
Holden, G., Barker, K., Rosenberg, G., & Onghena, P. (2007). Assessing progress toward accreditation related objectives: Evidence regarding the use of self-efficacy as an outcome in the advanced concentration research curriculum. Research on Social Work Practice, 17(4), 456-465. https://doi.org/10.1177/1049731506297474 DOI: https://doi.org/10.1177/1049731506297474
Holden, G., Barker, K., Rosenberg, G., & Onghena, P. (2008). The evaluation self-efficacy scale for assessing progress toward CSWE accreditation- related objectives: A replication. Research on Social Work Practice, 18(1), 42-46. https://doi.org/10.1177/1049731507303954 DOI: https://doi.org/10.1177/1049731507303954
Jacobson, M., & Goheen, A. (2006). Engaging students in research: A participatory BSW program evaluation. Journal of Baccalaureate Social Work, 12(1), 87-104. https://doi.org/10.18084/1084-7219.12.1.87 DOI: https://doi.org/10.18084/1084-7219.12.1.87
Jenson, J. M. (2005). Connecting science to intervention: Advances, challenges, and the promise of evidence-based practice. Social Work Research, 29(3), 131-135. https://doi.org/10.1093/swr/29.3.131 DOI: https://doi.org/10.1093/swr/29.3.131
Kane, M. & Trochim, W. M. (2007). Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412983730 DOI: https://doi.org/10.4135/9781412983730
Kirkhart, K. E. (2000). Reconceptualizing evaluation use: An integrated theory of influence. New Directions for Evaluation, 88, 5-23. https://doi.org/10.1002/ev.1188 DOI: https://doi.org/10.1002/ev.1188
Kittle, C. B. & Gross, C. (2005). An alternative model of field instruction for BSW students. The Journal of Baccalaureate Social Work, 10(2), 41- 52. https://doi.org/10.18084/1084-7219.10.2.41 DOI: https://doi.org/10.18084/1084-7219.10.2.41
Kouzes, J. & Posner, B. (1997). Leadership practices inventory: Participants workbook. San Francisco: Jossey Bass.
Lam, D. (2004). Problem-based learning: An integration of theory and field. Journal of Social Work Education, 40(3), 371-389. https://doi.org/10.1080/10437797.2004.10672294 DOI: https://doi.org/10.1080/10437797.2004.10672294
National Association of Social Workers (2006). Code of ethics of the National Association of Social Workers. Washington, DC: NASW.
Ohmer, M. L. (2007). Citizen participation in neighborhood organizations and its relationship to volunteers' self- and collective efficacy and sense of community. Social Work Research, 31(2), 109-120. https://doi.org/10.1093/swr/31.2.109 DOI: https://doi.org/10.1093/swr/31.2.109
Patton, M. Q. (1996). A world larger than formative and summative. Evaluation Practice, 17(2), 131-144. https://doi.org/10.1177/109821409601700205 DOI: https://doi.org/10.1177/109821409601700205
Patton, M. Q. (1997). Utilization-focused evaluation (3rd ed.). Thousand Oaks, CA: Sage.
Penka, C. E., & Kirk, S. A. (1991). Practitioner involvement in clinical evaluation. Social Work, 36, 513-518.
Petrovich, A. (2004). Using self-efficacy theory in social work teaching. Journal of Social Work Education, 40(3), 429- 443. https://doi.org/10.1080/10437797.2004.10672298 DOI: https://doi.org/10.1080/10437797.2004.10672298
Rank, M. G., & Hutchison, W. S. (2000). An analysis of leadership within the social work profession. Journal of Social Work Education, 36(3), 487- 502. https://doi.org/10.1080/10437797.2000.10779024 DOI: https://doi.org/10.1080/10437797.2000.10779024
Ritter, L. A., & Sue, V. M. (2007). (Eds). Introduction to using online surveys. New Directions for Evaluation, 115, 5- 14. https://doi.org/10.1002/ev.230 DOI: https://doi.org/10.1002/ev.230
Rosas, S. R., & Camphausen, L. C. (2007). The use of concept mapping for scale development and validation in evaluation. Evaluation and Program Planning, 30, 125-135. https://doi.org/10.1016/j.evalprogplan.2007.01.003 DOI: https://doi.org/10.1016/j.evalprogplan.2007.01.003
Shaw, I. & Faulkner, A. (2006). Practitioner evaluation at work. American Journal of Evaluation, 27(1), 44-63. https://doi.org/10.1177/1098214005284968 DOI: https://doi.org/10.1177/1098214005284968
Smith, D. C., & Hall, J. A.(2008). Strengths-Oriented family therapy for adolescents with substance abuse problems. Social Work, 53(2), 185- 188. https://doi.org/10.1093/sw/53.2.185 DOI: https://doi.org/10.1093/sw/53.2.185
Sisco, S., Volland, P., & Gorin, S. (2005). Social work leadership and aging: Meeting the demographic imperative. Health & Social Work, 30(4), 344-347. https://doi.org/10.1093/hsw/30.4.344 DOI: https://doi.org/10.1093/hsw/30.4.344
Staudt, M. M. (2007). Two years later: Former students' perceptions of a clinical evaluation course and current evaluation practices. Journal of Teaching in Social Work, 27(1/2), 125- 139. https://doi.org/10.1300/J067v27n01_08 DOI: https://doi.org/10.1300/J067v27n01_08
Trochim, W. M. (1989). An introduction to concept mapping for planning and evaluation. Evaluation and Program Planning, 12, 143-153. https://doi.org/10.1016/0149-7189(89)90016-5 DOI: https://doi.org/10.1016/0149-7189(89)90005-0
Weiss, C. H. (1980). Knowledge creep and decision accretion. Knowledge: Creation, Diffusion, Utilization, 1, 381- 404. https://doi.org/10.1177/107554708000100303 DOI: https://doi.org/10.1177/107554708000100303
Weiss, C. H., Murphy-Graham, E., & Birkeland, S. (2005). An alternate route to policy influence: How evaluations affect D.A.R.E. American Journal of Evaluation, 26(1), 12-30. https://doi.org/10.1177/1098214004273337 DOI: https://doi.org/10.1177/1098214004273337
Wimpfheimer, S. (2004). Leadership and management competencies defined by practicing social work managers: An overview of standards developed by the National Network for Social Work Managers. Administration in Social Work, 28(1), 45-56. https://doi.org/10.1300/J147v28n01_04 DOI: https://doi.org/10.1300/J147v28n01_04