Stakeholder Involvement in Evaluation: Three Decades of the American Journal of Evaluation
Main Article Content
Abstract
Background: Stakeholder involvement in various phases of evaluation has received increasing attention over the past three decades. Indeed, the American Journal of Evaluation (AJE) has reflected this overall philosophy and strategy through a number of publications about several theoretical frameworks and practical applications. Those AJE articles outline the primary assumptions of the stakeholder approaches to evaluation, their practical applications, constraints, and benefits for providing a new direction in evaluation.
Purpose: What lessons are there for our field concerning the way that stakeholder involvement has been conceptualized and applied in AJE? This article focuses on the ways in which AJE authors have approached the notion of stakeholder involvement over the past three decades, drawing on key articles from scholarship on this topic.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Desk review.
Findings: This review shows how AJE has enhanced our understanding of the evolution of these approaches to evaluation, from a global perspective to differentiated approaches with a shared theme.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Abma, T. A. (2006). The practice and politics of responsive evaluation. American Journal of Evaluation, 27(1), 31-43. https://doi.org/10.1177/1098214005283189 DOI: https://doi.org/10.1177/1098214005283189
Alkin, M. C. (Ed.). (2004). Evaluation roots: Tracing theorists' views and influences. Thousand Oaks, CA: Sage. Alkin, M. C. (2005). Utilization of evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation. Thousand Oaks, CA: Sage.
Altschuld, J. W., Yoon, J. S., & Cullen, C. (1993). The utilization of needs assessment results. Evaluation and Program Planning, 16, 279-285. https://doi.org/10.1016/0149-7189(93)90040-F DOI: https://doi.org/10.1016/0149-7189(93)90040-F
Azzam, T. (2010). Evaluator responsiveness to stakeholders. American Journal of Evaluation, 31(1), 45-65. https://doi.org/10.1177/1098214009354917 DOI: https://doi.org/10.1177/1098214009354917
Arnold, M. E. (2006). Developing evaluation capacity in extension 4-H field faculty: A framework for success. American Journal of Evaluation, 27(2), 257-269. https://doi.org/10.1177/1098214006287989 DOI: https://doi.org/10.1177/1098214006287989
Bamberger, M. (2000). The evaluation of international development programs: A view from the front. American Journal of Evaluation, 21(1), 95-102. https://doi.org/10.1177/109821400002100108 DOI: https://doi.org/10.1016/S1098-2140(00)00050-3
Bledsoe, K. L., & Graham, J. A. (2005). The use of multiple evaluation approaches in program evaluation. American Journal of Evaluation, 26(3), 302-319. https://doi.org/10.1177/1098214005278749 DOI: https://doi.org/10.1177/1098214005278749
https://doi.org/10.1177/1098214005283189 https://doi.org/10.1177/1098214005283189 DOI: https://doi.org/10.1177/1098214005283189
Botcheva, L., Shih, J., & Huffman, L. C. (2009). Emphasizing cultural competence in evaluation: A process-oriented approach. American Journal of Evaluation, 30(2), 176-188. https://doi.org/10.1177/1098214009334363 DOI: https://doi.org/10.1177/1098214009334363
Brandon, P. R. (1998). Stakeholder participation for the purpose of helping ensure evaluation validity: Bridging the gap between collaborative and non-collaborative evaluations. American Journal of Evaluation, 19(3), 325-337. Brunner, I., & Guzman, A. (1989). Participatory evaluation: A tool to assess projects and empower people. New Directions for Program Evaluation, 42, 9-17. https://doi.org/10.1016/S1098-2140(99)80215-X DOI: https://doi.org/10.1016/S1098-2140(99)80215-X
Bryk, A. (Ed.). (1983). Stakeholder-based evaluation. New Directions for Program Evaluation, 17. https://doi.org/10.1002/ev.1321 DOI: https://doi.org/10.1002/ev.1321
Campbell, R., Adams, A. E., & Patterson, D. (2008). Methodological challenges of collecting evaluation data from traumatized clients/consumers: A comparison of three methods. American Journal of Evaluation, 29(3), 369-381. Cartland, J., Ruch-Ross, H. S., Mason, M., & Donohue, W. (2008). Role sharing between evaluators and stakeholders in practice. American Journal of Evaluation, 29(4), 460-477. https://doi.org/10.1177/1098214008320736 DOI: https://doi.org/10.1177/1098214008326201
Checkoway, B., & Richards-Schuster, K. (2003). Youth participation in community evaluation research. American Journal of Evaluation, 24(1), 21-33. https://doi.org/10.1177/109821400302400103 DOI: https://doi.org/10.1177/109821400302400103
Christie, C. A. (2005). A conversation with Russ Conner, the Colorado Trust community-based collaborative evaluation. American Journal of Evaluation, 26(3), 369-377. https://doi.org/10.1177/1098214005278956 DOI: https://doi.org/10.1177/1098214005278956
Christie, C. A., & Alkin, M. C. (2003). The user-oriented evaluator's role in formulating a program theory: Using a theory-driven approach. American Journal of Evaluation, 24(3), 373-385. https://doi.org/10.1177/109821400302400306 DOI: https://doi.org/10.1177/109821400302400306
Cooksy, L. J. (2007). Ethical challenges scenario: Youth involvement in evaluation. American Journal of Evaluation, 28(3), 318-320. https://doi.org/10.1177/1098214007306378 DOI: https://doi.org/10.1177/1098214007306378
Cousins, J. B., Donohue, J. J., & Bloom, G. A. (1996). Collaborative evaluation in North America: Evaluators' self-reported opinions, practices and consequences. American Journal of Evaluation, 17(3), 207-226. https://doi.org/10.1016/S0886-1633(96)90002-1 DOI: https://doi.org/10.1016/S0886-1633(96)90002-1
Cousins, J. B., & Earl, L. M. (1992). The case for participatory evaluation. Educational Evaluation and Policy Analysis, 14(4), 397-418. https://doi.org/10.3102/01623737014004397 DOI: https://doi.org/10.3102/01623737014004397
Cousins, J. B., & Earl, L. M. (1995). Participatory evaluation in education: Studies of evaluation use and organizational learning. London: Falmer.
Cousins, J. B., & Earl, L. M. (1999). When the boat gets missed: Response to M.F. Smith. American Journal of Evaluation, 20(2), 309-317. https://doi.org/10.1177/109821409902000212 DOI: https://doi.org/10.1016/S1098-2140(99)00015-6
Cousins, J. B., & Shulha, L. M. (2008). Complexities in setting program standards in collaborative evaluation. In N. Smith & P. R. Brandon (Eds.), Fundamental issues in evaluation. New York, NY: The Guilford Press.
Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 80, 5-23. Daigneault, P-M., & Jacob, S. (2009). Toward accurate measurement of participation: Rethinking the conceptualization and operationalization of participatory evaluation. American Journal of Evaluation, 30(3), 330-348. https://doi.org/10.1002/ev.1114 DOI: https://doi.org/10.1177/1098214009340580
Donaldson, S. I., & Gooler, L. E. (2002). Theory-driven evaluation of the work and health initiative: A focus on winning new jobs. American Journal of Evaluation, 23(3), 341-346. https://doi.org/10.1177/109821400202300310 DOI: https://doi.org/10.1177/109821400202300310
Fetterman, D. M. (1993). Theme for 1993 annual meeting: Empowerment evaluation. American Journal of Evaluation, 14(1), 115-117. https://doi.org/10.1016/0886-1633(93)90049-U DOI: https://doi.org/10.1016/0886-1633(93)90049-U
Fetterman, D. M. (1994). Empowerment evaluation. American Journal of Evaluation, 15(1), 1- 15. https://doi.org/10.1016/0886-1633(94)90055-8 DOI: https://doi.org/10.1016/0886-1633(94)90055-8
Fetterman, D. M. (1995). In response to Dr. Daniel Stufflebeam's empowerment evaluation, objectivist evaluation, and evaluation standards: Where the future of evaluation should not go and where it needs to go. American Journal of Evaluation, 16(2), 179-199. https://doi.org/10.1016/0886-1633(95)90026-8 DOI: https://doi.org/10.1016/0886-1633(95)90026-8
Fetterman, D. (1997). Empowerment Evaluation: A Response to Patton and Scriven. American Journal of Evaluation, 18(3), 253-266. https://doi.org/10.1016/S0886-1633(97)90033-7 DOI: https://doi.org/10.1016/S0886-1633(97)90033-7
Fetterman, D. M. (2001a). Foundations of empowerment evaluation. Thousand Oaks, CA: Sage.
Fetterman, D. M. (2001b). The transformation of evaluation into a collaboration: A vision of evaluation in the 21st century. American Journal of Evaluation, 22(3), 381-385. https://doi.org/10.1016/S1098-2140(01)00152-7 DOI: https://doi.org/10.1016/S1098-2140(01)00152-7
Fetterman, D. M. (2005). In response to Drs. Patton and Scriven. American Journal of Evaluation, 26(3), 418-420. https://doi.org/10.1177/1098214005278769 DOI: https://doi.org/10.1177/1098214005278769
Fetterman, D. M., Kaftarian, S., & Wandersman, A. (Eds.). (1996). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.
Fetterman, D. M., & Wandersman, A. (Eds.). (2005). Empowerment evaluation principles in practice. New York, NY: Guilford.
Fetterman, D. M., & Wandersman, A. (2007). Empowerment evaluation: Yesterday, today, and tomorrow. American Journal of Evaluation, 28(2), 179-198. https://doi.org/10.1177/1098214007301350 DOI: https://doi.org/10.1177/1098214007301350
Fetterman, D. M., & Wandersman, A. (2010, November). Empowerment Evaluation Essentials: Highlighting the Essential Features of Empowerment Evaluation. Paper presented at the American Evaluation Association Conference, San Antonio, Texas.
Flores, K. S. (2008). Youth participatory evaluation: Strategies for engaging young people. San Francisco, CA: Jossey-Bass.
Gajda, R. (2004). Utilizing collaboration theory to evaluate strategic alliances. American Journal of Evaluation, 25(1), 65-77. https://doi.org/10.1177/109821400402500105 DOI: https://doi.org/10.1177/109821400402500105
Garaway, G. B. (1995). Participatory evaluation. Studies in Educational Evaluation, 21, 85-102. https://doi.org/10.1016/0191-491X(95)00007-H DOI: https://doi.org/10.1016/0191-491X(95)00007-H
Gill, S. J., & Zimmerman, N. R. (1990). Racial/ethnic and gender bias in the courts: A stakeholder-focused evaluation. American Journal of Evaluation, 11(2), 103-108. https://doi.org/10.1177/109821409001100202 DOI: https://doi.org/10.1177/109821409001100202
Gong, J., & Wright, D. (2007). The context of power: Young people as evaluators. American Journal of Evaluation, 28(3), 327-333. https://doi.org/10.1177/1098214007306680 DOI: https://doi.org/10.1177/1098214007306680
Greene, J. C. (1988). Stakeholder participation and utilization in program evaluation. Evaluation Review, 12, 91-116. https://doi.org/10.1177/0193841X8801200201 DOI: https://doi.org/10.1177/0193841X8801200201
Greene, J. C. (2005). Stakeholder. In S. Mathison (Ed.), Encyclopedia of evaluation. Thousand Oaks, CA: Sage. Green, B. L., Mulvey, L., Fisher, H. A., & Woratschek, F. (1996). Integrating program and evaluation values: A family support approach to program evaluation. American Journal of Evaluation, 17(3), 261-272. https://doi.org/10.1016/S0886-1633(96)90006-9 DOI: https://doi.org/10.1016/S0886-1633(96)90006-9
Guba, E. G. (1969). The failure of educational evaluation. Educational Technology, 9, 29-38.
Guba, E. G. (1978). Toward a methodology of naturalistic inquiry in educational evaluation. CSE Monograph 8. Los Angeles, CA: University of California, Center for the Study of Evaluation.
Guba, E. G. (1987). What have we learned about naturalistic evaluation? American Journal of Evaluation, 8(1), 23-43. https://doi.org/10.1177/109821408700800102 DOI: https://doi.org/10.1177/109821408700800102
Guba, E. G., & Lincoln, Y. S. (1981). Effective evaluation: Improving the usefulness of evaluation results through responsive and naturalistic approaches. Hoboken, NJ: John Wiley & Sons.
Guba, E. G., & Lincoln, Y. S. (1989). Fourth generation evaluation. Thousand Oaks, CA: Sage.
Hansen, M. B., & Vedung, E. (2010). Theory-based stakeholder evaluation. American Journal of Evaluation, 31(3), 295-313. https://doi.org/10.1177/1098214010366174 DOI: https://doi.org/10.1177/1098214010366174
Hendricks, M. (1987). A conversation with W. Haven North, Director, Center for Developmental Information and Evaluation, U.S. Agency for International Development. American Journal of Evaluation, 8(1), 55-63. https://doi.org/10.1177/109821408700800105 DOI: https://doi.org/10.1177/109821408700800105
Horton, D. (1999). Utilization-Focused Evaluation (Third Edition), by Michael Q. Patton. American Journal of Evaluation, 20(2), 399-401. https://doi.org/10.1177/109821409902000225 DOI: https://doi.org/10.1177/109821409902000225
House, E. R. (1980). Evaluating with validity. Beverly Hills, CA: Sage.
House, E. R., & Howe, K. R. (1998). The issue of advocacy in evaluations. American Journal of Evaluation, 19(2), 233-236. https://doi.org/10.1177/109821409801900209 DOI: https://doi.org/10.1177/109821409801900209
House, E. R., & Howe, K. R. (1999). Values in evaluation and social research. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781452243252 DOI: https://doi.org/10.4135/9781452243252
Howe, K. R., & Ashcraft, C. (2005). Deliberative democratic evaluation: Successes and limitations of an evaluation of school choice. Teachers College Record, 107(10), 2274-2297. https://doi.org/10.1111/j.1467-9620.2005.00592.x DOI: https://doi.org/10.1177/016146810510701004
Huffman, D., Thomas, K., & Lawrenz, F. (2008). A collaborative immersion approach to evaluation capacity building. American Journal of Evaluation, 29(3), 358-368. https://doi.org/10.1177/1098214008318798 DOI: https://doi.org/10.1177/1098214008318798
Johnson, R. B. (1995). Estimating an evaluation utilization model using conjoint measurement and analysis. Evaluation Review, 19(3), 313-338. https://doi.org/10.1177/0193841X9501900305 DOI: https://doi.org/10.1177/0193841X9501900305
Johnson, R. L., Willeke, M. J., & Steiner, D. J. (1998). Stakeholder collaboration in the design and implementation of a family literacy portfolio assessment. American Journal of Evaluation, 19(3), 339-353. https://doi.org/10.1177/109821409801900306 DOI: https://doi.org/10.1177/109821409801900306
Kistler, S. (2010). TIG membership and proposal submission background information. American Evaluation Association report.
King, J. A. (2006) Practicing evaluation: A collaborative approach. American Journal of Evaluation, 27(2), 277-278. Kirkhart, K. E. (2010). Utilization-Focused Evaluation (2008), by Michael Quinn Patton. American Journal of Evaluation, 31(4), 588-596. https://doi.org/10.1177/1098214010373646 DOI: https://doi.org/10.1177/1098214010373646
Kushner, S. (2005). Democratic theorizing: From noun to participle. American Journal of Evaluation, 26(4), 579-581. https://doi.org/10.1177/1098214005281357 DOI: https://doi.org/10.1177/1098214005281357
Lackey, J. F., Moberg, D. P., & Balistrieri, M. (1997). By whose standards? Reflections on empowerment evaluation and grassroots groups. American Journal of Evaluation, 18(2), 137-146. https://doi.org/10.1016/S0886-1633(97)90018-0 DOI: https://doi.org/10.1016/S0886-1633(97)90018-0
Lawrenz, F., & Huffman, D. (2003). How can multi-site evaluations be participatory? American Journal of Evaluation, 24(4), 471-482. https://doi.org/10.1177/109821400302400404 DOI: https://doi.org/10.1177/109821400302400404
Lehtonen, M. (2006). Deliberative democracy, participation, and OECD peer reviews of environmental policies. American Journal of Evaluation, 27(2), 185-200. https://doi.org/10.1177/0198214006288283 DOI: https://doi.org/10.1177/0198214006288283
Leviton, L. C., & Hughes, E. F. X. (1981). Research on the utilization of evaluations: A review and synthesis. Evaluation Review, 5, 524-548. https://doi.org/10.1177/0193841X8100500405 DOI: https://doi.org/10.1177/0193841X8100500405
Lincoln, Y. S., & Guba, E. G. (1980). The distinction between merit and worth in evaluation. Educational Evaluation and Policy Analysis, 2(4), 61-71. https://doi.org/10.3102/01623737002004061 DOI: https://doi.org/10.3102/01623737002004061
Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage https://doi.org/10.1016/0147-1767(85)90062-8 DOI: https://doi.org/10.1016/0147-1767(85)90062-8
MacDonald, B. (1974). Evaluation and the control of education. In B. MacDonald & R. Walker (Eds.), Innovation, evaluation, research, and the problem of control. (SAFARI ONE). Norwich, UK: Centre for Applied Research in Education, University of East Anglia.
MacDonald, B. (1976). Evaluation and the control of education. In D. Tawney (Ed.), Curriculum evaluation today: Trends and implications. Schools Council Research Studies Series. London: Macmillan.
MacNeil, C. (2002). Evaluator as steward of citizen deliberation. American Journal of Evaluation, 23(1), 45-54. Mark, M. M. (2001). Evaluation's future: Furor, futile, or fertile? American Journal of Evaluation, 22(3), 457-479. Mark, M. M., & Shotland, R. L. (1985). Stakeholder-based evaluation and value judgments: The role of perceived power and legitimacy in the selection of stakeholder groups. Evaluation Review, 9, 605-626.
Martens, K. (2008). Youth Participatory Evaluation: Strategies for Engaging Young People, by K. S. Flores. American Journal of Evaluation, 29(4), 590-591. https://doi.org/10.1177/1098214008325025 DOI: https://doi.org/10.1177/1098214008325025
Mathison, S. (2001). What's it like when the participatory evaluator is a "genuine" stakeholder? American Journal of Evaluation, 22(1), 29-35. https://doi.org/10.1016/S1098-2140(01)00107-2 DOI: https://doi.org/10.1016/S1098-2140(01)00107-2
McTaggart, R. (1991). When democratic evaluation doesn't seem democratic. American Journal of Evaluation, 12(1), 9-21. https://doi.org/10.1177/109821409101200103 DOI: https://doi.org/10.1177/109821409101200103
Miller, R. L., & Campbell, R. (2006). Taking stock of empowerment evaluation: An empirical review. American Journal of Evaluation, 27(3), 296-319. https://doi.org/10.1177/109821400602700303 DOI: https://doi.org/10.1177/109821400602700303
Miller, R. L., & Campbell, R. (2007). Taking stock again results in the same conclusions: A reply to Fetterman and Wandersman's defense of empowerment evaluation. American Journal of Evaluation, 28(4), 579-581. https://doi.org/10.1177/1098214007308901 DOI: https://doi.org/10.1177/1098214007308901
Morabito, S. M. (2002). Evaluator roles and strategies for expanding evaluation process influence. American Journal of Evaluation, 23(3), 321-330. https://doi.org/10.1177/109821400202300307 DOI: https://doi.org/10.1016/S1098-2140(02)00200-X
Orr, S. K. (2010). Exploring stakeholder values and interests in evaluation. American Journal of Evaluation, 31(4), 557-569. https://doi.org/10.1177/1098214010372668 DOI: https://doi.org/10.1177/1098214010372668
O'Sullivan, R. G. (2004). Practicing evaluation: A collaborative approach. Thousand Oaks, CA: Sage. O'Sullivan, R. (2007). Collaborative Evaluations: A Step-by-Step Model for the Evaluator, by Liliana Rodriguez-Campos. American Journal of Evaluation, 28(3), 381-382. https://doi.org/10.1177/1098214007306681 DOI: https://doi.org/10.1177/1098214007306681
O'Sullivan, R. G., & D'Agostino, A. (2002). Promoting evaluation through collaboration: Findings from community-based programs for young children and their families. Evaluation, 8(3), 372-387. https://doi.org/10.1177/135638902401462466 DOI: https://doi.org/10.1177/135638902401462466
Patton, M. Q. (1978) Utilization-focused evaluation. Thousand Oaks, CA: Sage. Patton, M. Q. (1986) Utilization-focused evaluation. (2nd ed.) Thousand Oaks, CA: Sage.
Patton, M. Q. (1988). Reports on topic areas: The evaluator's responsibility for utilization. American Journal of Evaluation, 9(2), 5-24. https://doi.org/10.1177/109821408800900201 DOI: https://doi.org/10.1177/109821408800900201
Patton, M. Q. (1994). Developmental evaluation. American Journal of Evaluation, 15(3), 311- 319. https://doi.org/10.1177/109821409401500312 DOI: https://doi.org/10.1177/109821409401500312
Patton, M. Q. (1996) Utilization-focused evaluation: The new century text. (3rd ed.) Thousand Oaks, CA: Sage. Patton, M. Q. (1997a). Toward distinguishing empowerment evaluation and placing it in a larger context. American Journal of Evaluation, 18(2), 147-163. https://doi.org/10.1177/109821409701800206 DOI: https://doi.org/10.1177/109821409701800206
Patton, M. Q. (1997b). Of vacuum cleaners and toolboxes: A response to Fetterman's response. American Journal of Evaluation, 18(3), 267-270. https://doi.org/10.1177/109821409701800309 DOI: https://doi.org/10.1177/109821409701800309
Patton, M. Q. (2005). Toward distinguishing empowerment evaluation and placing it in a larger context: Take two. American Journal of Evaluation, 26(3), 408-414. https://doi.org/10.1177/1098214005277353 DOI: https://doi.org/10.1177/1098214005277353
Patton, M. Q. (2008) Utilization-focused evaluation. (4th ed.) Thousand Oaks, CA: Sage.
Patton, M. Q. (2010). Developmental evaluation: Applying complexity concepts to enhance innovations and use. New York, NY: Guilford.
Pechman, E. M. (1982). Optimizing evaluation use. American Journal of Evaluation, 3(4), 64-67. https://doi.org/10.1177/109821408200300416 DOI: https://doi.org/10.1177/109821408200300416
Perry, P. D., & Backus, C. A. (1995). A different perspective on empowerment in evaluation: benefits and risks to the evaluation process. American Journal of Evaluation, 16(1), 37-46. https://doi.org/10.1016/0886-1633(95)90005-5 DOI: https://doi.org/10.1016/0886-1633(95)90005-5
Preskill, H., & Boyle, S. (2008). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443-459. https://doi.org/10.1177/1098214008324182 DOI: https://doi.org/10.1177/1098214008324182
Preskill, H., & Torres, R. T. (1999). Building capacity for organizational learning through evaluative inquiry. Evaluation, 5, 42-60. https://doi.org/10.1177/13563899922208814 DOI: https://doi.org/10.1177/13563899922208814
Preskill, H., Zuckerman, B., & Matthews, B. (2003). An exploratory study of process use: Findings and implications for future research. American Journal of Evaluation, 24(4), 423-442. https://doi.org/10.1177/109821400302400402 DOI: https://doi.org/10.1177/109821400302400402
Reed, M. C. (1999). Utilization-focused Evaluation: The new century text (3rd ed.), by Michael Quinn Patton. American Journal of Evaluation, 20(1), 151-153. https://doi.org/10.1177/109821409902000119 DOI: https://doi.org/10.1177/109821409902000119
Reineke, R. A. (1991). Stakeholder involvement in evaluation: Suggestions for practice. American Journal of Evaluation, 12(1), 39-44. https://doi.org/10.1177/109821409101200106 DOI: https://doi.org/10.1177/109821409101200106
Rodríguez-Campos, L. (2005). Collaborative evaluations: A step-by-step model for the evaluator. Tamarac, FL: Llumina Press.
Rodríguez-Campos, L. (2008). Evaluaciones colaborativas: Un modelo paso a paso para el evaluador [Collaborative evaluations: A step-by-step model for the evaluator]. Tamarac, FL: Llumina Press.
Rodríguez-Campos, L., & O'Sullivan, R. (2010, November). Collaborative Evaluation Essentials: Highlighting the Essential Features of Collaborative Evaluation. Paper presented at the American Evaluation Association Conference, San Antonio, Texas.
Rogers, S. J., Ahmed, M., Hamdallah, M., & Little, S. (2010). Garnering grantee buy-in on a national cross-site evaluation: The case of connect HIV. American Journal of Evaluation, 31(4), 447-462. https://doi.org/10.1177/1098214010372409 DOI: https://doi.org/10.1177/1098214010372409
Ryan, K. E. (2004). Serving public interests in educational accountability: Alternative approaches to democratic evaluation. American Journal of Evaluation, 25(4), 443-460 https://doi.org/10.1177/109821400402500403 DOI: https://doi.org/10.1016/j.ameval.2004.09.005
Ryan, K., Greene, J., Lincoln, Y., Mathison, S., & Mertens, D. M. (1998). Advantages and challenges of using inclusive evaluation approaches in evaluation practice. American Journal of Evaluation, 19(1), 101-122. https://doi.org/10.1177/109821409801900111 DOI: https://doi.org/10.1177/109821409801900111
Sanders, J. R. (2003). Mainstreaming evaluation. New Directions for Evaluation, 99, 3-6. https://doi.org/10.1002/ev.89 DOI: https://doi.org/10.1002/ev.89
Schnoes, C. J., Murphy-Berman, V., & Chambers, J. M. (2000). Empowerment evaluation applied: Experiences, analysis, and recommendations from a case study. American Journal of Evaluation, 21(1), 53-64. https://doi.org/10.1177/109821400002100105 DOI: https://doi.org/10.1177/109821400002100105
Scriven, M. (1991). Evaluation thesaurus (4th ed.). Newbury Park, CA: Sage Publications, Inc.
Scriven, M. (1997a). Empowerment evaluation examined. American Journal of Evaluation, 18(2), 165-175. https://doi.org/10.1177/109821409701800207 DOI: https://doi.org/10.1177/109821409701800207
Scriven, M. (1997b). Comments on Fettermans' response. American Journal of Evaluation, 18(3), 271-272. https://doi.org/10.1016/S0886-1633(97)90035-0 DOI: https://doi.org/10.1177/109821409701800310
Scriven, M. (2005). Empowerment evaluation principles in practice. American Journal of Evaluation, 26(3), 415- 417. https://doi.org/10.1177/1098214005276491 DOI: https://doi.org/10.1177/1098214005276491
Shulha, L. (2010, November). Participatory Evaluation Essentials: Highlighting the Essential Features of Participatory Evaluation. Paper presented at the American Evaluation Association Conference, San Antonio, Texas. Shulha, L. M., & Cousins, J. B. (1997). Evaluation use: Theory, research, and practice since 1986. American Journal of Evaluation, 18(1), 195-208. https://doi.org/10.1016/S0886-1633(97)90027-1 DOI: https://doi.org/10.1016/S0886-1633(97)90027-1
Skolits, G. J., & Boser, J. A. (2008). Using an evaluation hotline to promote stakeholder involvement. American Journal of Evaluation, 29(1), 58-70. https://doi.org/10.1177/1098214007312777 DOI: https://doi.org/10.1177/1098214007312777
Smith, M. F. (1999). Participatory evaluation: not working or not tested? American Journal of Evaluation, 20(2), 295-308. https://doi.org/10.1016/S1098-2140(99)00016-8 DOI: https://doi.org/10.1016/S1098-2140(99)00016-8
Smith, N. L. (2007). Empowerment evaluation as evaluation ideology. American Journal of Evaluation, 28(2), 169-178. https://doi.org/10.1177/1098214006294722 DOI: https://doi.org/10.1177/1098214006294722
Smith, N. L., & Young, M. J. (1987). Utilization-focused evaluation, by Michael Q. Patton, 1986, (2nd ed.), American Journal of Evaluation, 8(1), 46-49. https://doi.org/10.1177/109821408700800407 DOI: https://doi.org/10.1177/109821408700800407
Smits, P. A., & Champagne, F. (2008). An assessment of the theoretical underpinnings of practical participatory evaluation. American Journal of Evaluation, 29(4), 427-442. https://doi.org/10.1177/1098214008325023 DOI: https://doi.org/10.1177/1098214008325023
Spiegel, A. N., Bruning, R. H., & Giddings, L. (1999). Using responsive evaluation to evaluate a professional conference. American Journal of Evaluation, 20(1), 57-67. https://doi.org/10.1177/109821409902000105 DOI: https://doi.org/10.1177/109821409902000105
Stake, B. (2004). How far dare an evaluator go toward saving the world? American Journal of Evaluation, 25(1), 103-107. https://doi.org/10.1016/j.ameval.2003.12.001 DOI: https://doi.org/10.1016/j.ameval.2003.12.001
Stake, R. E. (1967). The countenance of educational evaluation. Teachers College Record, 68, 523-540. https://doi.org/10.1177/016146816706800707 DOI: https://doi.org/10.1177/016146816706800707
Stake, R. E. (1969). Evaluation design, instrumentation, data collection, and analysis of data. In J. L. Davis (Ed.), Educational evaluation. Columbus, OH: State Superintended of Public Instruction.
Stake, R. E. (1973). Program evaluation, particularly responsive evaluation. Keynote address at the conference "New Trends in Evaluation," Institute of Education, University of Goteborg, Sweden, Oct. 1973. In G. F. Madaus, M. S. Scriven, & D. L. Stufflebeam (Eds.), Evaluation models: Viewpoints on educational and human services evaluation. Boston: Kluwer-Nijhoff, 1987.
Stake, R. E. (1975). Evaluating the arts in education: A responsive approach. Columbus, OH: Merrill.
Stake, R. E. (1980). Program evaluation, particularly responsive evaluation. In W. B. Dockrell & D. Hamilton (Eds.), Rethinking educational research. London: Hodeder & Stoughton.
Stake, R. E. (1981). Setting standards for educational evaluators. American Journal of Evaluation, 2(2), 148-152. Stake, R. E. (1991a). Retrospective on "The countenance of educational evaluation." In M. W. McLaughlin & D. C. Phillips (Eds.), Evaluation and education: At quarter century. Ninetieth Yearbook of the National Society for the Study of Education, Part II. Chicago: University of Chicago Press. https://doi.org/10.1177/109821408100200215 DOI: https://doi.org/10.1177/109821408100200215
Stake, R. E. (1991b). Excerpts from: "Program evaluation, particularly responsive evaluation". American Journal of Evaluation, 12(1), 63-76. https://doi.org/10.1177/109821409101200109 DOI: https://doi.org/10.1177/109821409101200109
Stake, R. E. (2003). Standard-based and responsive evaluation. Thousand Oaks, CA: Sage.
Stake, R. E., & Schwandt, T. A. (2006). On discerning quality in evaluation. In I. F. Shaw, J. C. Greene, & M. M. Mark (Eds.), The Sage handbook of evaluation. Thousand Oak, CA: Sage. Stufflebeam, D. L. (1994). Empowerment evaluation, objectivist evaluation, and evaluation standards: where the future of evaluation should not go and where it needs to go. American Journal of Evaluation, 15(3), 321-338. https://doi.org/10.4135/9781848608078.n18 DOI: https://doi.org/10.1016/0886-1633(94)90027-2
Suárez-Balcázar, Y., & Harper, G. (Eds.) (2004). Empowerment and participatory evaluation of community interventions: Multiple benefits. Binghamton, NY: The Haworth Press.
Sullins, C. D., (2003). Adapting the empowerment evaluation model: A mental health drop-in center case example. American Journal of Evaluation, 24(3), 387-398. https://doi.org/10.1177/109821400302400307 DOI: https://doi.org/10.1016/j.ameval.2003.08.002
Taut, S. M., & Alkin, M. C. (2003). Program staff perceptions of barriers to evaluation implementation. American Journal of Evaluation, 24(2), 213-226. https://doi.org/10.1177/109821400302400205 DOI: https://doi.org/10.1177/109821400302400205
Thiele, G., Devaux, A., Velasco, C., & Horton, D. (2007). Horizontal evaluation: Fostering knowledge sharing and program improvement within a network. American Journal of Evaluation, 28(4), 493-508. https://doi.org/10.1177/1098214007308989 DOI: https://doi.org/10.1177/1098214007308989
Toal, S. A. (2009). The validation of the evaluation involvement scale for use in multisite settings. American Journal of Evaluation, 30(3), 349-362. https://doi.org/10.1177/1098214009337031 DOI: https://doi.org/10.1177/1098214009337031
Trochim, W. M., Marcus, S. E., Mâsse, L. C., Moser, R. P., & Weld, P. C. (2008). The evaluation of large research initiatives: A participatory integrative mixed-methods approach. American Journal of Evaluation, 29(1), 8-28. Walker, K. (2007). Youth empowerment evaluation: Learning voice. American Journal of Evaluation, 28(3), 321-326. https://doi.org/10.1177/1098214007309280 DOI: https://doi.org/10.1177/1098214007309280
Wallerstein, N., & Martinez, L. (1994). Empowerment Evaluation: A case study of an adolescent substance abuse prevention program in New Mexico. American Journal of Evaluation, 15(2), 131-138. https://doi.org/10.1016/0886-1633(94)90004-3 DOI: https://doi.org/10.1177/109821409401500203
Wandersman, A. (2009). Four Keys to Success (Theory, Implementation, Evaluation, and Resource/System Support): High Hopes and Challenges in Participation. American Journal of Community Psychology, 43(1-2), 3-21. Wandersman, A., & Snell-Johns, J. (2005). Empowerment evaluation: Clarity, dialogue, and growth. American Journal of Evaluation, 26(3), 421-428. https://doi.org/10.1007/s10464-008-9212-x DOI: https://doi.org/10.1007/s10464-008-9212-x
Weiss, C. H. (1998). Have we learned anything new about the use of evaluation? American Journal of Evaluation, 19(1), 21-33. https://doi.org/10.1016/S1098-2140(99)80178-7 DOI: https://doi.org/10.1016/S1098-2140(99)80178-7
Yeh, S. S. (2000a). Building the knowledge base for improving educational and social programs through planned variation evaluations. American Journal of Evaluation, 21(1), 27-40. https://doi.org/10.1016/S1098-2140(00)00054-0 DOI: https://doi.org/10.1016/S1098-2140(00)00054-0
Yeh, S. S. (2000b). Improving educational and social programs: A planned variation cross-validation model. American Journal of Evaluation, 21(2), 171-184. https://doi.org/10.1016/S1098-2140(00)00076-X DOI: https://doi.org/10.1016/S1098-2140(00)00076-X