A Lesson in Carefully Managing Resources: A Case Study from an Evaluation of a Music Education Program
Main Article Content
Abstract
Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team.
Purpose: Through a case study of a local education program, the authors explore the challenges and possible solutions of evaluating a program within time, budget, data, and political constraints.
Setting: The case study of a local music education program is implemented in a medium size Midwestern town.
Intervention: The local music education program is a participatory music program for preschool-aged children. The program provides a combination of music classes, performances, and parent education to all participants, with further musical opportunities for interested parents and children.
Research Design: The research and data collection portion of the evaluation was conducted using participatory strategies, and involved a management oriented approach.
Data Collection and Analysis: Data collection for years one and two (process) consisted of primarily qualitative methods, triangulated by exploratory quantitative data collection. Data collection for year three (impact) will consist of primarily quantitative methods, triangulated with results from the qualitative analysis done in years one and two.
Findings: Four factors, time, data, budget, and political, constrain the design and conduct of a local evaluation, yet, evaluators may implement multiple solutions that lessen the effect of the constraints on the evaluation.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Bamberger, M., Rugh, J., & Mabry, L. (2006). RealWorld evaluation: Working under budget, time, data, and political constraints. Thousand Oaks, CA: Sage.
Coryn, C. L., & Hobson, K. A. (2011). Using nonequivalent dependent variables to reduce internal validity threats in quasi-experiments: Rationale, history, and examples from practice. In S. Mathison (Ed.), Really new directions in evaluation: Young evaluators' perspectives. New Directions for Evaluation (Vol. 131, pp. 31-39). San Francisco, CA: Joesy-Bass. https://doi.org/10.1002/ev.375 DOI: https://doi.org/10.1002/ev.375
Donaldson, S. I., Christie, C. A., & Mark, M. M. (Eds.). (2009). What counts as credible evidence in applied research and evlauation practice? Thousan Oaks, CA: Sage. https://doi.org/10.4135/9781412995634 DOI: https://doi.org/10.4135/9781412995634
Patton, M. Q. (2008). Utilization focused evaluation (4th ed.). Thousand Oaks, CA: SAGE Publications.
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford.
Rossi, P., Lipsey, M., & Freeman, H. (2004). Evaluation: A systematic approach (7th ed.). Thousand Oaks, CA: SAGE Publications, Inc.
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation: Theories of practice. Newbury Park, CA: Sage.
The Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards (2nd ed.). Thousand Oaks, CA: Sage.